-- Logs begin at Thu 2022-08-04 03:10:12 UTC, end at Thu 2022-08-04 04:55:44 UTC. -- Aug 04 04:26:23.046104 dv-cinder-851279-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 04:26:23.054738 dv-cinder-851279-5-smb devstack@keystone.service[80390]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 04:26:23 2022] *** Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: nodename: dv-cinder-851279-5-smb Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: machine: x86_64 Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: clock source: unix Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: pcre jit disabled Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: detected number of CPU cores: 4 Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: current working directory: / Aug 04 04:26:23.056774 dv-cinder-851279-5-smb devstack@keystone.service[80390]: detected binary path: /usr/bin/uwsgi-core Aug 04 04:26:23.057316 dv-cinder-851279-5-smb devstack@keystone.service[80390]: your processes number limit is 47680 Aug 04 04:26:23.057316 dv-cinder-851279-5-smb devstack@keystone.service[80390]: your memory page size is 4096 bytes Aug 04 04:26:23.057316 dv-cinder-851279-5-smb devstack@keystone.service[80390]: detected max file descriptor number: 2048 Aug 04 04:26:23.057316 dv-cinder-851279-5-smb devstack@keystone.service[80390]: lock engine: pthread robust mutexes Aug 04 04:26:23.057316 dv-cinder-851279-5-smb devstack@keystone.service[80390]: thunder lock: enabled Aug 04 04:26:23.057316 dv-cinder-851279-5-smb devstack@keystone.service[80390]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 04:26:23.057316 dv-cinder-851279-5-smb devstack@keystone.service[80390]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 04:26:23.097508 dv-cinder-851279-5-smb devstack@keystone.service[80390]: Python main interpreter initialized at 0x562d254959c0 Aug 04 04:26:23.097508 dv-cinder-851279-5-smb devstack@keystone.service[80390]: python threads support enabled Aug 04 04:26:23.097508 dv-cinder-851279-5-smb devstack@keystone.service[80390]: your server socket listen backlog is limited to 100 connections Aug 04 04:26:23.097508 dv-cinder-851279-5-smb devstack@keystone.service[80390]: your mercy for graceful operations on workers is 90 seconds Aug 04 04:26:23.097964 dv-cinder-851279-5-smb devstack@keystone.service[80390]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 04:26:23.097964 dv-cinder-851279-5-smb devstack@keystone.service[80390]: *** Operational MODE: preforking *** Aug 04 04:26:23.098214 dv-cinder-851279-5-smb devstack@keystone.service[80390]: *** uWSGI is running in multiple interpreter mode *** Aug 04 04:26:23.098214 dv-cinder-851279-5-smb devstack@keystone.service[80390]: spawned uWSGI master process (pid: 80390) Aug 04 04:26:23.098425 dv-cinder-851279-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 04 04:26:23.103140 dv-cinder-851279-5-smb devstack@keystone.service[80390]: spawned uWSGI worker 1 (pid: 80398, cores: 1) Aug 04 04:26:23.103140 dv-cinder-851279-5-smb devstack@keystone.service[80390]: spawned uWSGI worker 2 (pid: 80399, cores: 1) Aug 04 04:26:23.103140 dv-cinder-851279-5-smb devstack@keystone.service[80390]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 04:26:28.645329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:26:28.645329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes Aug 04 04:26:28.646105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:26:28.646105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: from cryptography.utils import int_from_bytes Aug 04 04:26:28.646513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:26:28.646513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: from cryptography.utils import int_from_bytes Aug 04 04:26:28.646618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 04:26:28.646618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: from cryptography.utils import int_from_bytes Aug 04 04:26:28.696065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:26:28.696246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:26:28.696339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 04:26:28.696433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] command line args: [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:26:28.696507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 04:26:28.696669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] command line args: [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 04:26:28.696747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:26:28.696856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ================================================================================ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:26:28.696943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 04:26:28.697101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ================================================================================ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 04:26:28.697180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] admin_token = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.697346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config_dir = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.697424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.697534 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.697614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_dir = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.697716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] config_source = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.697801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.697878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] debug = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.697959 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] config_source = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.698079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.698324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] debug = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.698324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.698462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.698528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.698676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.698785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.698882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_config_append = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_config_append = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699745 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.699942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_dir = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_dir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700466 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700732 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.700930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.701992 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.702145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.702223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.702377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.702454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.703154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.703301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.703407 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.703490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.703653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.703736 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.703925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.704014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.704415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.704493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.704618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] publish_errors = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.704692 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] publish_errors = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.704814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.704889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705117 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] standard_threads = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.705988 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] standard_threads = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_journal = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706781 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_journal = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_json = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.706936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_json = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.707051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_stderr = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.707126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_stderr = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.707202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] use_syslog = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.707280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] use_syslog = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.707433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.707512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 04:26:28.707687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.707765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.707926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.708012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.708185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.708267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.708420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.708496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.708667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.708752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.708903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.708985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.709149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.709226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.709383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.709468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.709631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.709707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.709877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.709954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.710123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.710209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.710354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.710431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.710599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.710689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.710832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.710921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.711102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.711183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.711352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.711429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.711586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.711739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.711820 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.711892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.712080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.712157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.712323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.712407 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.712556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.712633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.712807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.712884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.713064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.713149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.713317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.713394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.713569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.713647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.713799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.713878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.714028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.714105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.714258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.714334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.714492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.714570 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.714736 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.714819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.714999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.715081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.715234 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.715314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.715464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.715542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.715709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.715786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.715955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.716033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.716299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.716481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.716481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.716785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.716932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717504 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717768 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.717923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.718009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.718156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.718234 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.719006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.719127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.719226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.719592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.719734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.719869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.719953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720025 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.720889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.721050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.721126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.721430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.721585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.721585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.721784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.721880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.721982 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.721982 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.722170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.722276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.722356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.722470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.722591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.722668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.722793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.722870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.723057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.723144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.723253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.723378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.723534 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.723650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.723792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.723880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.724029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.724110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.724263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.724343 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.724502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.724585 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.724742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.724824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.724990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.725071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.725230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.725313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.725466 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.725548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.725704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.725786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.725939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.726025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.726175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.726257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.726412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.726493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.726653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.726732 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.726891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.727066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.727154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.727228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.727368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.727500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.727605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.727685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.727839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.727919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.728076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.728200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.728314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.728392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.728550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.728629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.728784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.728863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.729025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.729111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.729265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.729436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.729588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.729665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.729735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.729806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.729937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.730039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.730168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.730261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.730399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.730501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.730634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.730736 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.730874 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.730953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.731137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.731210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.731376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.731446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.731627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.731704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.731868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.731937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.732123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.732197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.732376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.732456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.732615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.732685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.732844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.external = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.732911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.733076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.733152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.733349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.733423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.733588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.external = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.733658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.736385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.password = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.736510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.736594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] auth.token = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.736681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.736757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.736836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.736910 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.736981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.password = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] auth.token = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.737973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738407 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738701 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.738911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739034 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739338 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.739938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740151 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740894 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.740993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.741126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.741206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.741372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.741451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.741610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.741699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.741845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.741924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.742085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.742163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.742320 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.742407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.742563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.742642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.742797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.742874 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.743051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.743135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.743303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.743384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.743552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.743655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.743821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.743898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.744008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.744133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.744254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.744382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.744470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.744622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.744708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.744857 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.744937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.745106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.745194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.745338 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.745417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.745575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.745654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.745825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.745912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.746065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.746143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.746293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.746373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.746530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.746660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.746741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.746813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.747004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.747088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.747257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.747346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.747506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.747584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.747743 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.747820 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.747975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.748065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.748212 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.748290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.748446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.748587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.748719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.748858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.749007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.749130 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.749130 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.749382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.749509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.750233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.750328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.750451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.750451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.750687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.750815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.750951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.751070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.751198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.751323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.751457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.751587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.751726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.751854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.751982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.752112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.752239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.752365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.752501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.752631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.752755 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.752894 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.753027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.753166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.753319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.753453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.753590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.753722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.753853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.753984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.754123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.754256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.754387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.754518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.754648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.754779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.754917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.755099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.755243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.755375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.755506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.755649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.755781 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.755913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.756044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.756174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.756306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.756444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.756576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.756714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.756853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.756985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.757667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.757803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.757938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.758075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.758204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.758334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.758471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.758554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.758720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.758848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.758976 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.759124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.759273 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.759404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.759532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.759662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.759789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.759918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.760058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.760186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.760318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.760441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.760570 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.760699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.760835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.760969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.761107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.761107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.761348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.761495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.761626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.761755 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.761882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.762010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.762137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.762137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.762386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.762514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.762642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.762775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.762913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.763090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.763225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.763359 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.763505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.763632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.763710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764138 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764651 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.764943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.765951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766391 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.766962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767893 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.767964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768034 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.768941 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.769098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.769178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.769346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.769429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.769594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.769673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.769843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.769923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.770077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.770158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.770327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.770509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.770590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.770749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.770837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.771027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.771112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.771270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.771472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.771552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.771714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.771796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.771968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.772049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.772220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.772299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.772470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.772551 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.772708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.772805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.772937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.773022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.773169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.773252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.773402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.773482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.773654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.773742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.773886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.773965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.774121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.774201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.774355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.774443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.774587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.774666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.774818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.774899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.775075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.775170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.775315 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.775395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.775561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.775640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.775793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.775881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.776030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.776110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.776267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.776353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.776513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.776600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.776748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.776827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.776990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.777068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.777238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.777327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.777473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.777552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.777708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.777791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.777944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.778033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.778189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.778269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.778425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.778505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.778652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.778786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.778886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.778965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.779169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.779253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.779419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.779512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.779651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.779746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.779894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.779974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.780132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.780211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.780374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.780456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.780610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.780699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.780871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.780952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.781107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.781188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.781345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.781428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.781590 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.781670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.781824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.781903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.782061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.782142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.782292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.782371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.782532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.782611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.782764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.782845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.783033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.783116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.783255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.783334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.783497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.783580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.783729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.783807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.783879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:26:28.783974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.784207 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.784446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.784681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 04:26:28.784850 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 04:26:28.813978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.814125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.814210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.814287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.814418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.814505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.822793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.822961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.853934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.854089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.854155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.854228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.906792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.907351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.958650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.958872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.959805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:28.960043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.024691 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.024909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.025974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.049681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.049807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.049909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.050978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.051103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.061907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.062667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.075283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.075511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.075596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.075729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.075815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.075944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.076027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.076154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.076247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.076362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.076445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.076573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.076654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80399) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.076788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 04:26:29.094290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.094496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 04:26:29.094735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.094819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.094945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 04:26:29.095090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 04:26:29.095288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.095371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.095493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 04:26:29.095575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.095763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.095847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.096013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.096093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.096265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.096518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.105837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.106110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.106194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.106376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.106460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.106653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.106738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.106953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.113744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.113975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.118569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.118671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.118842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.118926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.119146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.119230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.119428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.119512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.119707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.119790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.119971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.120078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.120264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.120360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.120502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.120821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.120900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.120983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.121059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.121132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.121245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.121363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.144824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.145086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.146311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.146580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.146664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.146854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.151218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.151488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.151574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.151761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.151856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.152038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.159199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.159293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.159450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.159532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.163612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.163879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.163962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.164157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.164240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.164435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.164520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.164713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.164796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.164996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.165087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.165258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.165342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.165517 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.165599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.165794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.181749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.182262 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.182361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.182361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.185960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.186559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.189690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.189980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.190402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.190695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.194674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.195113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.198271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.198354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.201493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.201788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.201909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.202075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.202195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.202368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.202467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.202704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.202831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.203004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.203136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.203415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.219688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.219944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.220027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.220211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.220291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.220471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.220551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.220737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.227326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.227609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.228884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.229158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.229270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.229427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.232051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.232293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.232394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.232571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.232659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.232848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.232937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.233121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.233210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.233392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.245057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.245171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.245335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.245450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.245608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.245698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.245879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.245965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.246153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.246237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.246420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.246502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.246705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.246790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.262875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.262998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.265962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.266069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.268999 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.269109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.271530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.271618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.273040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.273125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.273326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.273405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.273603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.273703 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.280066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.280159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.282211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.282306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.285166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.285270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.285456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.285544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.285736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.285826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.286007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.286095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.294287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.294378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.294580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.294668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.294857 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.294945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.301846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.301957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80399) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 04:26:29.302128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.302230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.302407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.302496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.302680 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.302768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.302950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.303061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.303241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.303330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.303512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.303593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.303788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.303869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.304173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.304260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.304440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.304529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.304706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.304784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.304972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.305059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.305233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.305312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.305493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80399) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.305572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 04:26:29.339848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d254959c0 pid: 80398 (default app) Aug 04 04:26:29.340614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d254959c0 pid: 80399 (default app) Aug 04 04:26:29.343138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1676d7-bc1a-4c63-94b4-88e433f5fd1c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:29.343454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1676d7-bc1a-4c63-94b4-88e433f5fd1c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:29.343728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1676d7-bc1a-4c63-94b4-88e433f5fd1c None None] PATH_INFO: `/v3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:29.347967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Thu Aug 4 04:26:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:37.003603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6d22-e7fd-4d8c-aa51-effd8380c36a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:37.004169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6d22-e7fd-4d8c-aa51-effd8380c36a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:37.004169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6d22-e7fd-4d8c-aa51-effd8380c36a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:37.008620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:26:37.013878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:37.014264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:37.014424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:37.084642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: INFO dbcounter [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] Registered counter for database keystone Aug 04 04:26:37.103505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG oslo_db.sqlalchemy.engines [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:26:37.110323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writer thread running {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:26:37.288821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80398) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 04:26:37.289157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG passlib.handlers.bcrypt [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80398) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 04:26:37.343194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:37.345334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:37.481840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 04:26:37.611620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6d22-e7fd-4d8c-aa51-effd8380c36a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:37.680218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: INFO dbcounter [None req-518d6d22-e7fd-4d8c-aa51-effd8380c36a None None] Registered counter for database keystone Aug 04 04:26:37.701158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG oslo_db.sqlalchemy.engines [None req-518d6d22-e7fd-4d8c-aa51-effd8380c36a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 04:26:37.707831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writer thread running {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 04:26:37.824171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6d22-e7fd-4d8c-aa51-effd8380c36a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:37.828939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3428b-dd28-4fe6-bbe2-7d9cbd235025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:37.829563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3428b-dd28-4fe6-bbe2-7d9cbd235025 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:37.829839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3428b-dd28-4fe6-bbe2-7d9cbd235025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:37.830104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3428b-dd28-4fe6-bbe2-7d9cbd235025 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:37.837995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3428b-dd28-4fe6-bbe2-7d9cbd235025 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:37.902035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5bf3428b-dd28-4fe6-bbe2-7d9cbd235025 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 04:26:37.902538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3428b-dd28-4fe6-bbe2-7d9cbd235025 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:37.915261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Aug 4 04:26:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 04:26:37.921456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:37.937143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abfed1-0646-4077-83d6-0799704654f8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:37.942589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ab30f-468a-46e1-9cef-279ad45a9c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:37.943766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab30f-468a-46e1-9cef-279ad45a9c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:37.944048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab30f-468a-46e1-9cef-279ad45a9c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:37.944316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ab30f-468a-46e1-9cef-279ad45a9c05 admin admin] PATH_INFO: `/v3/projects/998b35aeaf484d148461559c217775c3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:37.945845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ab30f-468a-46e1-9cef-279ad45a9c05 admin admin] RBAC: Authorizing `identity:get_project(project_id=998b35aeaf484d148461559c217775c3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:37.996548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING keystone.common.rbac_enforcer.enforcer [None req-349ab30f-468a-46e1-9cef-279ad45a9c05 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 04:26:37.996888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ab30f-468a-46e1-9cef-279ad45a9c05 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:38.002103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Thu Aug 4 04:26:37 2022] GET /identity/v3/projects/998b35aeaf484d148461559c217775c3 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:39.997918 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de80a-60c6-4014-9a44-6914f6a755d4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:39.998447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de80a-60c6-4014-9a44-6914f6a755d4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:39.998447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de80a-60c6-4014-9a44-6914f6a755d4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:40.002629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:40.007960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bf20e-18bf-47bf-a97f-00be6782154f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:40.008371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bf20e-18bf-47bf-a97f-00be6782154f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:40.008471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bf20e-18bf-47bf-a97f-00be6782154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:40.028296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-055bf20e-18bf-47bf-a97f-00be6782154f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:40.029779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-055bf20e-18bf-47bf-a97f-00be6782154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:40.038179 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 04:26:40.060316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de80a-60c6-4014-9a44-6914f6a755d4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:40.072390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de80a-60c6-4014-9a44-6914f6a755d4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:40.076635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be0236-19af-4174-b3cb-2da2032b4c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:40.077237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be0236-19af-4174-b3cb-2da2032b4c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:40.077519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be0236-19af-4174-b3cb-2da2032b4c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:40.077794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be0236-19af-4174-b3cb-2da2032b4c69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:40.086173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be0236-19af-4174-b3cb-2da2032b4c69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:40.088056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be0236-19af-4174-b3cb-2da2032b4c69 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:40.097402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Aug 4 04:26:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:26:40.102652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bf20e-18bf-47bf-a97f-00be6782154f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:40.111481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bf20e-18bf-47bf-a97f-00be6782154f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:40.115845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68d70b-8802-4960-b5af-e9bb17acc67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:40.116461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68d70b-8802-4960-b5af-e9bb17acc67c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:40.116739 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68d70b-8802-4960-b5af-e9bb17acc67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:40.117006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68d70b-8802-4960-b5af-e9bb17acc67c admin admin] PATH_INFO: `/v3/users/bf61353eb0614c70aa286ba9e0760696` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:40.118326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68d70b-8802-4960-b5af-e9bb17acc67c admin admin] RBAC: Authorizing `identity:get_user(user_id=bf61353eb0614c70aa286ba9e0760696)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:40.120151 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68d70b-8802-4960-b5af-e9bb17acc67c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:40.121661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Thu Aug 4 04:26:40 2022] GET /identity/v3/users/bf61353eb0614c70aa286ba9e0760696 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:42.161271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f47e5-501f-447e-93cb-13a3e414facf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:42.161752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f47e5-501f-447e-93cb-13a3e414facf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:42.161752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f47e5-501f-447e-93cb-13a3e414facf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:42.163308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:42.168764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73054-48c9-47c4-b1c4-c30416ed6aa1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:42.169160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73054-48c9-47c4-b1c4-c30416ed6aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:42.169318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73054-48c9-47c4-b1c4-c30416ed6aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:42.189372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2bd73054-48c9-47c4-b1c4-c30416ed6aa1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:42.190557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2bd73054-48c9-47c4-b1c4-c30416ed6aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:42.240379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcd200-8995-4fd2-842a-a804fbd0eda8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:42.240660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcd200-8995-4fd2-842a-a804fbd0eda8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:42.240929 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcd200-8995-4fd2-842a-a804fbd0eda8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:42.242253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:26:42.247376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e7959-5107-45b7-b45a-113d7aa9cad3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:42.247654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e7959-5107-45b7-b45a-113d7aa9cad3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:42.247924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e7959-5107-45b7-b45a-113d7aa9cad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:42.271562 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:26:42.289049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG passlib.handlers.bcrypt [None req-583e7959-5107-45b7-b45a-113d7aa9cad3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80399) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 04:26:42.289475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG passlib.handlers.bcrypt [None req-583e7959-5107-45b7-b45a-113d7aa9cad3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80399) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 04:26:42.294380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd73054-48c9-47c4-b1c4-c30416ed6aa1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:42.319036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:42.336016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-583e7959-5107-45b7-b45a-113d7aa9cad3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:42.337626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-583e7959-5107-45b7-b45a-113d7aa9cad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:42.400512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd73054-48c9-47c4-b1c4-c30416ed6aa1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:42.434861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7769ae7-2854-44bb-8bde-7a7f67149c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:42.435536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7769ae7-2854-44bb-8bde-7a7f67149c8c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:42.435813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7769ae7-2854-44bb-8bde-7a7f67149c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:42.436086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7769ae7-2854-44bb-8bde-7a7f67149c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:42.436969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:26:42.447778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7769ae7-2854-44bb-8bde-7a7f67149c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e7769ae7-2854-44bb-8bde-7a7f67149c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:26:42.456646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:26:42.457690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:26:42.458531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:26:42.460999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e7959-5107-45b7-b45a-113d7aa9cad3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:42.463559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7769ae7-2854-44bb-8bde-7a7f67149c8c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:42.545188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:42.563547 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e7959-5107-45b7-b45a-113d7aa9cad3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:42.563920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7769ae7-2854-44bb-8bde-7a7f67149c8c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:42.566614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:42.597637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cdf6a-bed9-44c6-b252-b7a204d83112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:42.598249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cdf6a-bed9-44c6-b252-b7a204d83112 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:42.598533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cdf6a-bed9-44c6-b252-b7a204d83112 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:42.598805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cdf6a-bed9-44c6-b252-b7a204d83112 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:42.599559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cdf6a-bed9-44c6-b252-b7a204d83112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:42.599865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cdf6a-bed9-44c6-b252-b7a204d83112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:42.601245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cdf6a-bed9-44c6-b252-b7a204d83112 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:42.604100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d15e7-11c1-4f25-8bf6-99f1d96af3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:42.604958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d15e7-11c1-4f25-8bf6-99f1d96af3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:42.605243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d15e7-11c1-4f25-8bf6-99f1d96af3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:42.605518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d15e7-11c1-4f25-8bf6-99f1d96af3f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:42.613709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:42.619215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cdf6a-bed9-44c6-b252-b7a204d83112 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:42.674418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d15e7-11c1-4f25-8bf6-99f1d96af3f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:42.676112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d15e7-11c1-4f25-8bf6-99f1d96af3f0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:42.720550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cdf6a-bed9-44c6-b252-b7a204d83112 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:42.779376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:26:42.785906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d15e7-11c1-4f25-8bf6-99f1d96af3f0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:42.789923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:42.865643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a182b-d77a-4bdf-bbd3-07e570997419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:42.866276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a182b-d77a-4bdf-bbd3-07e570997419 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:42.866554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a182b-d77a-4bdf-bbd3-07e570997419 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:42.866822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a182b-d77a-4bdf-bbd3-07e570997419 None admin] PATH_INFO: `/v3/users/bf61353eb0614c70aa286ba9e0760696` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:42.868027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a182b-d77a-4bdf-bbd3-07e570997419 None admin] RBAC: Authorizing `identity:get_user(user_id=bf61353eb0614c70aa286ba9e0760696)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:42.869450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a182b-d77a-4bdf-bbd3-07e570997419 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:42.871046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:26:42 2022] GET /identity/v3/users/bf61353eb0614c70aa286ba9e0760696 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:26:42.876484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a182b-d77a-4bdf-bbd3-07e570997419 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:42.889304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d15e7-11c1-4f25-8bf6-99f1d96af3f0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:42.891554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:42.926317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2edcf-2390-4824-b0de-2fe463b2fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:42.927221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2edcf-2390-4824-b0de-2fe463b2fc7c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:42.927562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2edcf-2390-4824-b0de-2fe463b2fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:42.927841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2edcf-2390-4824-b0de-2fe463b2fc7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:42.945645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2edcf-2390-4824-b0de-2fe463b2fc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:42.947138 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2edcf-2390-4824-b0de-2fe463b2fc7c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c7c2edcf-2390-4824-b0de-2fe463b2fc7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:26:42.965575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:26:42.966552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:26:42.967381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:26:42.967381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:26:42.967381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:26:42.967381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:26:42.967381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 9/18] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:26:42.973282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2edcf-2390-4824-b0de-2fe463b2fc7c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:42.977132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a182b-d77a-4bdf-bbd3-07e570997419 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:43.012073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5d96-2568-49bf-b76b-5e755768ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:43.012710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5d96-2568-49bf-b76b-5e755768ea9b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:43.012989 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5d96-2568-49bf-b76b-5e755768ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:43.013257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5d96-2568-49bf-b76b-5e755768ea9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:43.014403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b5d96-2568-49bf-b76b-5e755768ea9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:43.015864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b5d96-2568-49bf-b76b-5e755768ea9b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:43.017438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:26:43.023207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5d96-2568-49bf-b76b-5e755768ea9b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:43.033011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:43.081139 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2edcf-2390-4824-b0de-2fe463b2fc7c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:43.105188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:43.116290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439432f-dd7c-4cc1-9878-f1908807f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:43.116906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439432f-dd7c-4cc1-9878-f1908807f5de None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:43.117184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439432f-dd7c-4cc1-9878-f1908807f5de None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:43.117453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439432f-dd7c-4cc1-9878-f1908807f5de None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:43.118136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439432f-dd7c-4cc1-9878-f1908807f5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:43.118431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439432f-dd7c-4cc1-9878-f1908807f5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:43.119833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439432f-dd7c-4cc1-9878-f1908807f5de None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:43.124954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5d96-2568-49bf-b76b-5e755768ea9b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:43.137537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:43.159933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c313ce9-d60c-4e4b-a18c-70f7e1ff61b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:43.160571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c313ce9-d60c-4e4b-a18c-70f7e1ff61b0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:43.160860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c313ce9-d60c-4e4b-a18c-70f7e1ff61b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:43.161134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c313ce9-d60c-4e4b-a18c-70f7e1ff61b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:43.161952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c313ce9-d60c-4e4b-a18c-70f7e1ff61b0 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.domain.id=default, user.id=bf61353eb0614c70aa286ba9e0760696) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:43.162261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c313ce9-d60c-4e4b-a18c-70f7e1ff61b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:43.163778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c313ce9-d60c-4e4b-a18c-70f7e1ff61b0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:43.172465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Aug 4 04:26:43 2022] GET /identity/v3/role_assignments?user.id=bf61353eb0614c70aa286ba9e0760696&scope.domain.id=default&role.id=c1429555635349208e8b2bd908436746 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:26:45.599417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d90e5-bb36-4368-b3dc-1a665a9e5252 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:45.599924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d90e5-bb36-4368-b3dc-1a665a9e5252 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:45.600031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d90e5-bb36-4368-b3dc-1a665a9e5252 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:45.601470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:45.608132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20e40e-3e59-4dea-888f-a91ac942e54b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:45.608530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20e40e-3e59-4dea-888f-a91ac942e54b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:45.608701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20e40e-3e59-4dea-888f-a91ac942e54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:45.636278 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5d20e40e-3e59-4dea-888f-a91ac942e54b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:45.637487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d20e40e-3e59-4dea-888f-a91ac942e54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:45.678278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76db02a-4d5a-4f92-95d7-a67ba4d0f472 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:45.678574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76db02a-4d5a-4f92-95d7-a67ba4d0f472 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:45.678832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76db02a-4d5a-4f92-95d7-a67ba4d0f472 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:45.680514 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 12/23] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:45.685030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c73ad-6bba-4470-8989-92186ab93a3c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:45.685318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c73ad-6bba-4470-8989-92186ab93a3c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:45.685603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c73ad-6bba-4470-8989-92186ab93a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:45.723898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-138c73ad-6bba-4470-8989-92186ab93a3c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:45.725102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-138c73ad-6bba-4470-8989-92186ab93a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:45.799592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:45.830529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20e40e-3e59-4dea-888f-a91ac942e54b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:45.881524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 13/25] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:45.920153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c73ad-6bba-4470-8989-92186ab93a3c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:45.957524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:45.994787 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20e40e-3e59-4dea-888f-a91ac942e54b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:46.020239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:46.036602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4738c-8b0c-4f28-a56f-fbaaae02d95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:46.037563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4738c-8b0c-4f28-a56f-fbaaae02d95e None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.038059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4738c-8b0c-4f28-a56f-fbaaae02d95e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.038525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4738c-8b0c-4f28-a56f-fbaaae02d95e None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.039493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4738c-8b0c-4f28-a56f-fbaaae02d95e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:46.041093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4738c-8b0c-4f28-a56f-fbaaae02d95e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:46.134221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c73ad-6bba-4470-8989-92186ab93a3c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:46.206878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a1995-ae32-4fd8-b775-25cbd6e43487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:46.207933 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1995-ae32-4fd8-b775-25cbd6e43487 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.208438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1995-ae32-4fd8-b775-25cbd6e43487 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.208903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1995-ae32-4fd8-b775-25cbd6e43487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.220259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1995-ae32-4fd8-b775-25cbd6e43487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:46.222137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1995-ae32-4fd8-b775-25cbd6e43487 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:46.226384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 13/26] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Aug 4 04:26:45 2022] POST /identity/v3/roles => generated 219 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:26:46.228246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b127e9-6bb4-49a1-98a9-2576ab17e115 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.228723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b127e9-6bb4-49a1-98a9-2576ab17e115 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.229197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b127e9-6bb4-49a1-98a9-2576ab17e115 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.230876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:46.232386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc178-0b39-49fd-88f0-ca835747f50e None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.232872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc178-0b39-49fd-88f0-ca835747f50e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.233310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc178-0b39-49fd-88f0-ca835747f50e None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.235460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 15/28] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-eb7a1995-ae32-4fd8-b775-25cbd6e43487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:26:46.244261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:26:46.245331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:26:46.246329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:26:46.246329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:26:46.246329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:26:46.246329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:26:46.246598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11751a-677a-4cef-bad2-c91d213cb8d3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.246598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11751a-677a-4cef-bad2-c91d213cb8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.246598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11751a-677a-4cef-bad2-c91d213cb8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.249288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 14/29] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:26:46.251594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c561e2-5f55-482c-8822-12643f0da2ee None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.252114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c561e2-5f55-482c-8822-12643f0da2ee None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.252603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c561e2-5f55-482c-8822-12643f0da2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.274180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-40c561e2-5f55-482c-8822-12643f0da2ee None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:46.275772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-40c561e2-5f55-482c-8822-12643f0da2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:46.284070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9b11751a-677a-4cef-bad2-c91d213cb8d3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:46.285626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9b11751a-677a-4cef-bad2-c91d213cb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:46.362573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 15/30] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:46.363981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c561e2-5f55-482c-8822-12643f0da2ee None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:46.401023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:46.477708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 16/31] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:46.478710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11751a-677a-4cef-bad2-c91d213cb8d3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:46.574308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:46.620711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11751a-677a-4cef-bad2-c91d213cb8d3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:46.631866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c561e2-5f55-482c-8822-12643f0da2ee None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:46.664353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65285bce-24ec-44f6-a71b-ca0b5fb8ddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:46.664934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65285bce-24ec-44f6-a71b-ca0b5fb8ddb6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.665222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65285bce-24ec-44f6-a71b-ca0b5fb8ddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.665504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65285bce-24ec-44f6-a71b-ca0b5fb8ddb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.679677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65285bce-24ec-44f6-a71b-ca0b5fb8ddb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:26:46.682414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a887f3c-d516-4603-995f-fd97b3934304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:46.683332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a887f3c-d516-4603-995f-fd97b3934304 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.683806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a887f3c-d516-4603-995f-fd97b3934304 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.684270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a887f3c-d516-4603-995f-fd97b3934304 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-65285bce-24ec-44f6-a71b-ca0b5fb8ddb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:26:46.685017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:26:46.685890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:26:46.686627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 17/32] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:26:46.687252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65285bce-24ec-44f6-a71b-ca0b5fb8ddb6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:46.688057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a887f3c-d516-4603-995f-fd97b3934304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:46.688556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a887f3c-d516-4603-995f-fd97b3934304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:46.690230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a887f3c-d516-4603-995f-fd97b3934304 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:46.705382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 16/33] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:46.706916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61e0f3-08c2-4dfd-b054-300e82943009 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.707393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61e0f3-08c2-4dfd-b054-300e82943009 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.707823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61e0f3-08c2-4dfd-b054-300e82943009 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.709224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 17/34] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:46.709911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61e0f3-08c2-4dfd-b054-300e82943009 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:46.814292 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:46.824587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65285bce-24ec-44f6-a71b-ca0b5fb8ddb6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:46.830053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61e0f3-08c2-4dfd-b054-300e82943009 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:46.850612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:46.864633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab19f79-0e6c-4fcb-ae9a-52e995b148a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:46.865433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab19f79-0e6c-4fcb-ae9a-52e995b148a5 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.865723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab19f79-0e6c-4fcb-ae9a-52e995b148a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.866009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab19f79-0e6c-4fcb-ae9a-52e995b148a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.866736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab19f79-0e6c-4fcb-ae9a-52e995b148a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:46.868290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab19f79-0e6c-4fcb-ae9a-52e995b148a5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:46.869121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b488c91-dfea-4547-8d2d-bd1c9564b6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:46.869796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488c91-dfea-4547-8d2d-bd1c9564b6df None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.870074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488c91-dfea-4547-8d2d-bd1c9564b6df None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.870369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b488c91-dfea-4547-8d2d-bd1c9564b6df None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.871119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b488c91-dfea-4547-8d2d-bd1c9564b6df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:46.871418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b488c91-dfea-4547-8d2d-bd1c9564b6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:46.872838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b488c91-dfea-4547-8d2d-bd1c9564b6df None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:46.885742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 18/35] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Aug 4 04:26:46 2022] POST /identity/v3/roles => generated 225 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:26:46.886582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 18/36] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:46.887409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab19f79-0e6c-4fcb-ae9a-52e995b148a5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:46.892558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d62b7-a8ac-466c-9280-97c7343c18be None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:46.892847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d62b7-a8ac-466c-9280-97c7343c18be None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:46.893124 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d62b7-a8ac-466c-9280-97c7343c18be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:46.913824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ec7d62b7-a8ac-466c-9280-97c7343c18be None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:46.915445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ec7d62b7-a8ac-466c-9280-97c7343c18be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:47.014765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 19/37] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:47.016259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d62b7-a8ac-466c-9280-97c7343c18be None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:47.030131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab19f79-0e6c-4fcb-ae9a-52e995b148a5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:47.071583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59392513-71b9-43e2-8cf4-a6ef9a7b2ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:47.072439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392513-71b9-43e2-8cf4-a6ef9a7b2ef9 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:47.072544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392513-71b9-43e2-8cf4-a6ef9a7b2ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:47.072761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392513-71b9-43e2-8cf4-a6ef9a7b2ef9 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:47.073647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59392513-71b9-43e2-8cf4-a6ef9a7b2ef9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:47.074944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59392513-71b9-43e2-8cf4-a6ef9a7b2ef9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:47.108033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 19/38] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:26:46 2022] POST /identity/v3/projects => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:26:47.109290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0f8b-2eba-49f8-9248-c7e5b786992b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:47.110182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0f8b-2eba-49f8-9248-c7e5b786992b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:47.110457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0f8b-2eba-49f8-9248-c7e5b786992b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:47.115718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 20/39] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:47.115718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0f8b-2eba-49f8-9248-c7e5b786992b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:47.134104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:47.159441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d62b7-a8ac-466c-9280-97c7343c18be None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:47.160213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:47.209706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002dcc9-a33c-47bb-bd9b-9717744723a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:47.210425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002dcc9-a33c-47bb-bd9b-9717744723a9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:47.210706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002dcc9-a33c-47bb-bd9b-9717744723a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:47.211312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002dcc9-a33c-47bb-bd9b-9717744723a9 None admin] PATH_INFO: `/v3/users/bf61353eb0614c70aa286ba9e0760696` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:47.214196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002dcc9-a33c-47bb-bd9b-9717744723a9 None admin] RBAC: Authorizing `identity:get_user(user_id=bf61353eb0614c70aa286ba9e0760696)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:47.215939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002dcc9-a33c-47bb-bd9b-9717744723a9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:47.217772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 20/40] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:26:47 2022] GET /identity/v3/users/bf61353eb0614c70aa286ba9e0760696 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:47.219590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f852d-caa5-4f5c-89b7-7552edf7530e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:47.219872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f852d-caa5-4f5c-89b7-7552edf7530e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:47.220227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f852d-caa5-4f5c-89b7-7552edf7530e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:47.239529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e70f852d-caa5-4f5c-89b7-7552edf7530e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:47.240744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e70f852d-caa5-4f5c-89b7-7552edf7530e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:47.248641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0f8b-2eba-49f8-9248-c7e5b786992b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:47.291051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64151a72-45c5-44ef-8d66-0857222d5c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:47.292002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151a72-45c5-44ef-8d66-0857222d5c78 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:47.292282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151a72-45c5-44ef-8d66-0857222d5c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:47.292558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151a72-45c5-44ef-8d66-0857222d5c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:47.293281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64151a72-45c5-44ef-8d66-0857222d5c78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:47.296634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64151a72-45c5-44ef-8d66-0857222d5c78 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:47.315251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 21/41] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Aug 4 04:26:47 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:26:47.316464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64151a72-45c5-44ef-8d66-0857222d5c78 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:47.325447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 21/42] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:47.353165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f852d-caa5-4f5c-89b7-7552edf7530e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:47.451311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:47.475938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:47.477565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f852d-caa5-4f5c-89b7-7552edf7530e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:47.486795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64151a72-45c5-44ef-8d66-0857222d5c78 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:47.524253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52c0de-8363-4329-926e-3b2f570f6659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:47.524914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52c0de-8363-4329-926e-3b2f570f6659 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:47.525194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52c0de-8363-4329-926e-3b2f570f6659 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:47.525472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52c0de-8363-4329-926e-3b2f570f6659 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:47.526680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52c0de-8363-4329-926e-3b2f570f6659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:47.528121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52c0de-8363-4329-926e-3b2f570f6659 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:47.529718 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 22/43] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:26:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:47.532256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e367e0-f27e-4bfb-858f-00a005963182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:47.533122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e367e0-f27e-4bfb-858f-00a005963182 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:47.533600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e367e0-f27e-4bfb-858f-00a005963182 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:47.534063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e367e0-f27e-4bfb-858f-00a005963182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:47.535578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e367e0-f27e-4bfb-858f-00a005963182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:47.536131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52c0de-8363-4329-926e-3b2f570f6659 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:47.537220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e367e0-f27e-4bfb-858f-00a005963182 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:47.540236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 22/44] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:26:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:47.546110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e367e0-f27e-4bfb-858f-00a005963182 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:47.638576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52c0de-8363-4329-926e-3b2f570f6659 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:47.653001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e367e0-f27e-4bfb-858f-00a005963182 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:47.675589 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233680ab-234b-4e94-83cb-9d77e807462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:47.677491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233680ab-234b-4e94-83cb-9d77e807462d None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:47.677774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233680ab-234b-4e94-83cb-9d77e807462d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:47.678043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233680ab-234b-4e94-83cb-9d77e807462d None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:47.678744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233680ab-234b-4e94-83cb-9d77e807462d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:47.680586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233680ab-234b-4e94-83cb-9d77e807462d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:47.687381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b645468-d816-47c3-85f5-a3191c5b2f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:47.688172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b645468-d816-47c3-85f5-a3191c5b2f51 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:47.688586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b645468-d816-47c3-85f5-a3191c5b2f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:47.688962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b645468-d816-47c3-85f5-a3191c5b2f51 None admin] PATH_INFO: `/v3/domains/default/users/bf61353eb0614c70aa286ba9e0760696/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:47.691096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b645468-d816-47c3-85f5-a3191c5b2f51 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bf61353eb0614c70aa286ba9e0760696, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:47.692552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b645468-d816-47c3-85f5-a3191c5b2f51 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:47.706747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:47.715612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 23/45] 10.222.0.57 () {58 vars in 1361 bytes} [Thu Aug 4 04:26:47 2022] PUT /identity/v3/domains/default/users/bf61353eb0614c70aa286ba9e0760696/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:26:47.830874 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:26:47 2022] POST /identity/v3/projects => generated 312 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:26:49.712979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75f6a-d8e7-4f0e-9d2c-0d73b48c56df None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:49.713493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75f6a-d8e7-4f0e-9d2c-0d73b48c56df None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:49.713575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75f6a-d8e7-4f0e-9d2c-0d73b48c56df None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:49.714894 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 24/47] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:49.720672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b28be-3b19-4b30-8679-187b147c6205 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:49.721110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b28be-3b19-4b30-8679-187b147c6205 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:49.721304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b28be-3b19-4b30-8679-187b147c6205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:49.740358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-656b28be-3b19-4b30-8679-187b147c6205 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:49.741882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-656b28be-3b19-4b30-8679-187b147c6205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:49.810331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 24/48] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:49.833298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75f6a-d8e7-4f0e-9d2c-0d73b48c56df None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:49.855350 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8150-2d10-40d4-a66f-5db9cd721b67 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:49.855848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8150-2d10-40d4-a66f-5db9cd721b67 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:49.856129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8150-2d10-40d4-a66f-5db9cd721b67 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:49.857476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 25/49] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:26:49.859063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:49.863125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c09ae0-7084-4ccd-8d4e-d48689fd681e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:49.863417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c09ae0-7084-4ccd-8d4e-d48689fd681e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:49.863701 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c09ae0-7084-4ccd-8d4e-d48689fd681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:49.882067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-87c09ae0-7084-4ccd-8d4e-d48689fd681e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:49.883319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-87c09ae0-7084-4ccd-8d4e-d48689fd681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:49.939465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75f6a-d8e7-4f0e-9d2c-0d73b48c56df None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:49.950670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 26/50] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:26:49.971824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa8031-1f24-42c7-a41a-3a47949961e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:49.972402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa8031-1f24-42c7-a41a-3a47949961e6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:49.972679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa8031-1f24-42c7-a41a-3a47949961e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:49.972948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa8031-1f24-42c7-a41a-3a47949961e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:49.973036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c09ae0-7084-4ccd-8d4e-d48689fd681e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:49.982850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa8031-1f24-42c7-a41a-3a47949961e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-19aa8031-1f24-42c7-a41a-3a47949961e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:26:49.988809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:26:49.989789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:26:49.990521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 25/51] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:26:49.995704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa8031-1f24-42c7-a41a-3a47949961e6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:50.031239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:50.072999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c09ae0-7084-4ccd-8d4e-d48689fd681e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:50.077048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:50.093663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa8031-1f24-42c7-a41a-3a47949961e6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:50.107674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589710d4-625f-4c15-a293-f75c729c39ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:50.108314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589710d4-625f-4c15-a293-f75c729c39ee None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:50.108591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589710d4-625f-4c15-a293-f75c729c39ee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:50.108862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589710d4-625f-4c15-a293-f75c729c39ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:50.110066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589710d4-625f-4c15-a293-f75c729c39ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:50.111691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589710d4-625f-4c15-a293-f75c729c39ee None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:50.113260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 27/52] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:26:50.119340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589710d4-625f-4c15-a293-f75c729c39ee None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:50.127270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605e6a7-c270-4f0b-a0f3-478d2cde8acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:50.127885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605e6a7-c270-4f0b-a0f3-478d2cde8acc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:50.128170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605e6a7-c270-4f0b-a0f3-478d2cde8acc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:50.128441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605e6a7-c270-4f0b-a0f3-478d2cde8acc None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:50.129165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605e6a7-c270-4f0b-a0f3-478d2cde8acc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:50.129466 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605e6a7-c270-4f0b-a0f3-478d2cde8acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:50.130834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605e6a7-c270-4f0b-a0f3-478d2cde8acc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:50.139426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:26:50.145800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605e6a7-c270-4f0b-a0f3-478d2cde8acc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:50.220632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589710d4-625f-4c15-a293-f75c729c39ee None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:50.244075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605e6a7-c270-4f0b-a0f3-478d2cde8acc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:50.245067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:50.257060 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708c420-2854-4f1b-b7ce-220235a3a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:50.257684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c420-2854-4f1b-b7ce-220235a3a5ea None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:50.257972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c420-2854-4f1b-b7ce-220235a3a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:50.258251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708c420-2854-4f1b-b7ce-220235a3a5ea None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:50.258934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708c420-2854-4f1b-b7ce-220235a3a5ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:50.260422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708c420-2854-4f1b-b7ce-220235a3a5ea None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:50.280781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1159d1a-74df-4308-945b-7be3e17c0e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:50.281424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1159d1a-74df-4308-945b-7be3e17c0e20 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:50.281708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1159d1a-74df-4308-945b-7be3e17c0e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:50.281986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1159d1a-74df-4308-945b-7be3e17c0e20 None admin] PATH_INFO: `/v3/users/bf61353eb0614c70aa286ba9e0760696` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:50.283193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1159d1a-74df-4308-945b-7be3e17c0e20 None admin] RBAC: Authorizing `identity:get_user(user_id=bf61353eb0614c70aa286ba9e0760696)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:50.284629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1159d1a-74df-4308-945b-7be3e17c0e20 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:50.286555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 27/54] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:26:50 2022] GET /identity/v3/users/bf61353eb0614c70aa286ba9e0760696 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:26:50.286708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 28/55] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Aug 4 04:26:50 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:26:50.292290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1159d1a-74df-4308-945b-7be3e17c0e20 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:50.310294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:50.408485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1159d1a-74df-4308-945b-7be3e17c0e20 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:50.443985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cad1e5-28e9-4d07-b48e-f7f48cb00664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:50.444635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad1e5-28e9-4d07-b48e-f7f48cb00664 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:50.444920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad1e5-28e9-4d07-b48e-f7f48cb00664 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:50.445196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad1e5-28e9-4d07-b48e-f7f48cb00664 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:50.446360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cad1e5-28e9-4d07-b48e-f7f48cb00664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:50.447863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cad1e5-28e9-4d07-b48e-f7f48cb00664 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:50.449495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 28/56] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:26:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:50.456026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708c420-2854-4f1b-b7ce-220235a3a5ea None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:50.556695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708c420-2854-4f1b-b7ce-220235a3a5ea None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:50.590462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a032229-fa20-4158-8ce2-fdf046b50eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:50.591129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032229-fa20-4158-8ce2-fdf046b50eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:50.591413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032229-fa20-4158-8ce2-fdf046b50eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:50.591688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032229-fa20-4158-8ce2-fdf046b50eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:50.592483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a032229-fa20-4158-8ce2-fdf046b50eb0 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.domain.id=default, user.id=bf61353eb0614c70aa286ba9e0760696) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:50.592793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a032229-fa20-4158-8ce2-fdf046b50eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:50.594840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a032229-fa20-4158-8ce2-fdf046b50eb0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:50.603982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 29/57] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Aug 4 04:26:50 2022] GET /identity/v3/role_assignments?user.id=bf61353eb0614c70aa286ba9e0760696&scope.domain.id=default&role.id=c1429555635349208e8b2bd908436746 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:52.290015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54691c4f-1903-472a-ac8b-7e468792f74f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:52.290522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54691c4f-1903-472a-ac8b-7e468792f74f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:52.290605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54691c4f-1903-472a-ac8b-7e468792f74f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:52.291990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 29/58] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:52.298145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f7277-379d-4e8b-8d5d-6dcb1651df0c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:52.298504 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f7277-379d-4e8b-8d5d-6dcb1651df0c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:52.298697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f7277-379d-4e8b-8d5d-6dcb1651df0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:52.316174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-386f7277-379d-4e8b-8d5d-6dcb1651df0c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:52.317353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-386f7277-379d-4e8b-8d5d-6dcb1651df0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:52.351324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:52.391908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 30/59] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:52.416196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54691c4f-1903-472a-ac8b-7e468792f74f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:52.497838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:52.517786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54691c4f-1903-472a-ac8b-7e468792f74f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:52.550261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bab88a-70d0-4dd9-8e07-1578aa828dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:52.550834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bab88a-70d0-4dd9-8e07-1578aa828dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:52.551139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bab88a-70d0-4dd9-8e07-1578aa828dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:52.551413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bab88a-70d0-4dd9-8e07-1578aa828dd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:52.552540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bab88a-70d0-4dd9-8e07-1578aa828dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:52.553961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bab88a-70d0-4dd9-8e07-1578aa828dd4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:52.555546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 30/60] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:26:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:52.561129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f7277-379d-4e8b-8d5d-6dcb1651df0c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:52.657073 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f7277-379d-4e8b-8d5d-6dcb1651df0c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:52.689949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c91707-6e5e-484d-b171-9f1a22c020f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:52.690562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c91707-6e5e-484d-b171-9f1a22c020f7 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:52.690844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c91707-6e5e-484d-b171-9f1a22c020f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:52.691175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c91707-6e5e-484d-b171-9f1a22c020f7 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:52.691850 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c91707-6e5e-484d-b171-9f1a22c020f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:52.693304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c91707-6e5e-484d-b171-9f1a22c020f7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:52.720336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 31/61] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:26:52 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:26:55.816943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89edec3-3e8e-4ec9-97e1-1fad76991354 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:55.817901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89edec3-3e8e-4ec9-97e1-1fad76991354 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:55.818401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89edec3-3e8e-4ec9-97e1-1fad76991354 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:55.820004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 31/62] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:55.825536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bc760-4d33-4c82-a105-ebdd12b68e51 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:55.826363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bc760-4d33-4c82-a105-ebdd12b68e51 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:55.826859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bc760-4d33-4c82-a105-ebdd12b68e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:55.852699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-524bc760-4d33-4c82-a105-ebdd12b68e51 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:55.854202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-524bc760-4d33-4c82-a105-ebdd12b68e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:55.885309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:55.949344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 32/63] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:55.992396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89edec3-3e8e-4ec9-97e1-1fad76991354 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:56.065474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ae24a-dee6-487b-955c-dd29a328c8be None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.066071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ae24a-dee6-487b-955c-dd29a328c8be None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.066546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ae24a-dee6-487b-955c-dd29a328c8be None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.068495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 33/64] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:56.074119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7a6b2-32aa-479d-b785-453ef501715c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.074704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7a6b2-32aa-479d-b785-453ef501715c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.075219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7a6b2-32aa-479d-b785-453ef501715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.093533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-78b7a6b2-32aa-479d-b785-453ef501715c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:56.095594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-78b7a6b2-32aa-479d-b785-453ef501715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:56.154523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89edec3-3e8e-4ec9-97e1-1fad76991354 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:56.210296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187578b4-c24b-4427-94c6-f8e3b783a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:56.211364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187578b4-c24b-4427-94c6-f8e3b783a554 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.211850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187578b4-c24b-4427-94c6-f8e3b783a554 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.212312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187578b4-c24b-4427-94c6-f8e3b783a554 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.215053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 34/65] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:56.216748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f95ca-f1ff-400b-a2ba-563509dc9213 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.217234 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f95ca-f1ff-400b-a2ba-563509dc9213 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.217700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f95ca-f1ff-400b-a2ba-563509dc9213 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.222756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 35/66] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:56.230962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187578b4-c24b-4427-94c6-f8e3b783a554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:26:56.232756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b24bd2-bfd4-498e-a1cb-9557b2233ba9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.233239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b24bd2-bfd4-498e-a1cb-9557b2233ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.233703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b24bd2-bfd4-498e-a1cb-9557b2233ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-187578b4-c24b-4427-94c6-f8e3b783a554 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:26:56.243626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:26:56.244507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:26:56.245330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 32/67] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:26:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:26:56.245926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187578b4-c24b-4427-94c6-f8e3b783a554 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:56.258908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-82b24bd2-bfd4-498e-a1cb-9557b2233ba9 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:56.259852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:56.260142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-82b24bd2-bfd4-498e-a1cb-9557b2233ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:56.333548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 36/68] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:56.334583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b24bd2-bfd4-498e-a1cb-9557b2233ba9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:56.365648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:56.371410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187578b4-c24b-4427-94c6-f8e3b783a554 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:56.415603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6943d-e31c-416b-95b0-589e8e76a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:56.416252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6943d-e31c-416b-95b0-589e8e76a581 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.416536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6943d-e31c-416b-95b0-589e8e76a581 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.416814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6943d-e31c-416b-95b0-589e8e76a581 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.427730 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6943d-e31c-416b-95b0-589e8e76a581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7bb6943d-e31c-416b-95b0-589e8e76a581 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:26:56.432904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:26:56.433759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:26:56.434490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:26:56.438970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 33/69] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:26:56.440185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d081cf-6fb6-4123-99f3-bfd1cba6a603 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.440677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d081cf-6fb6-4123-99f3-bfd1cba6a603 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.441186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d081cf-6fb6-4123-99f3-bfd1cba6a603 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.443020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 34/70] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:56.443354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d081cf-6fb6-4123-99f3-bfd1cba6a603 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:56.460323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b24bd2-bfd4-498e-a1cb-9557b2233ba9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:56.497660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079ca7a-515e-4acc-8e4b-08f6553f17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:56.498757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079ca7a-515e-4acc-8e4b-08f6553f17dd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.499392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079ca7a-515e-4acc-8e4b-08f6553f17dd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.499957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079ca7a-515e-4acc-8e4b-08f6553f17dd None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.500929 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079ca7a-515e-4acc-8e4b-08f6553f17dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:56.501428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079ca7a-515e-4acc-8e4b-08f6553f17dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:56.503303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079ca7a-515e-4acc-8e4b-08f6553f17dd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:56.512225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 37/71] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:26:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:56.513363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079ca7a-515e-4acc-8e4b-08f6553f17dd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:56.522396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:56.558684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d081cf-6fb6-4123-99f3-bfd1cba6a603 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:56.595568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595eb59-7ae0-4cd1-9fe6-4d83a3e73da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:56.596293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595eb59-7ae0-4cd1-9fe6-4d83a3e73da2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.596570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595eb59-7ae0-4cd1-9fe6-4d83a3e73da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.596840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595eb59-7ae0-4cd1-9fe6-4d83a3e73da2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.604847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:56.607481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595eb59-7ae0-4cd1-9fe6-4d83a3e73da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2595eb59-7ae0-4cd1-9fe6-4d83a3e73da2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:26:56.612501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:26:56.614537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 35/72] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:26:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:26:56.615650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1b191-519a-4237-8343-ba14c6e58317 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.616495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1b191-519a-4237-8343-ba14c6e58317 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.616495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1b191-519a-4237-8343-ba14c6e58317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.631381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079ca7a-515e-4acc-8e4b-08f6553f17dd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:56.632998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-97c1b191-519a-4237-8343-ba14c6e58317 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:56.634196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-97c1b191-519a-4237-8343-ba14c6e58317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:56.666384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd2a5f-8370-4936-b76c-9e10f840cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:56.667030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2a5f-8370-4936-b76c-9e10f840cd28 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.667318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2a5f-8370-4936-b76c-9e10f840cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.667589 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd2a5f-8370-4936-b76c-9e10f840cd28 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.668313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2a5f-8370-4936-b76c-9e10f840cd28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:56.668615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2a5f-8370-4936-b76c-9e10f840cd28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:56.670275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd2a5f-8370-4936-b76c-9e10f840cd28 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:56.679503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 38/73] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:56.680701 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9378-7a84-450d-aaa0-efee93c0db6a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.681000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9378-7a84-450d-aaa0-efee93c0db6a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.681281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9378-7a84-450d-aaa0-efee93c0db6a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.682633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 39/74] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:26:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:26:56.683211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9378-7a84-450d-aaa0-efee93c0db6a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:56.704037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 36/75] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:56.707175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1b191-519a-4237-8343-ba14c6e58317 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:56.778345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:56.792212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9378-7a84-450d-aaa0-efee93c0db6a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:56.822814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1b191-519a-4237-8343-ba14c6e58317 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:56.826737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba739cc-fa08-4fd5-8680-6df258dc342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:56.827409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba739cc-fa08-4fd5-8680-6df258dc342f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.827688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba739cc-fa08-4fd5-8680-6df258dc342f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.827957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba739cc-fa08-4fd5-8680-6df258dc342f None admin] PATH_INFO: `/v3/users/ec83bbe15a0149e7887bb8e59789155b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.845719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:56.848376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba739cc-fa08-4fd5-8680-6df258dc342f None admin] RBAC: Authorizing `identity:get_user(user_id=ec83bbe15a0149e7887bb8e59789155b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:56.849886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba739cc-fa08-4fd5-8680-6df258dc342f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:56.852111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 40/76] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:26:56 2022] GET /identity/v3/users/ec83bbe15a0149e7887bb8e59789155b => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:56.852827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba739cc-fa08-4fd5-8680-6df258dc342f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:56.869184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d697d1-7002-4ac6-96f5-3f686ca52bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:56.869813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d697d1-7002-4ac6-96f5-3f686ca52bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.870147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d697d1-7002-4ac6-96f5-3f686ca52bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.870424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d697d1-7002-4ac6-96f5-3f686ca52bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.871183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d697d1-7002-4ac6-96f5-3f686ca52bc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:56.871490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d697d1-7002-4ac6-96f5-3f686ca52bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:56.872855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d697d1-7002-4ac6-96f5-3f686ca52bc0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:56.881170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 37/77] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:26:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:56.882100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8dab-a661-4dd4-9d6e-0336d1fe925c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:56.882396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8dab-a661-4dd4-9d6e-0336d1fe925c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:56.882679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8dab-a661-4dd4-9d6e-0336d1fe925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:56.900122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ca3e8dab-a661-4dd4-9d6e-0336d1fe925c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:26:56.901318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ca3e8dab-a661-4dd4-9d6e-0336d1fe925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:26:56.959625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba739cc-fa08-4fd5-8680-6df258dc342f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:56.968796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 38/78] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:26:56.970248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e8dab-a661-4dd4-9d6e-0336d1fe925c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.002737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f6181-c05f-4ecc-aff8-62a1b7348b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.003392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f6181-c05f-4ecc-aff8-62a1b7348b16 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.003667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f6181-c05f-4ecc-aff8-62a1b7348b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.003940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f6181-c05f-4ecc-aff8-62a1b7348b16 None admin] PATH_INFO: `/v3/users/bf61353eb0614c70aa286ba9e0760696` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.005105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f6181-c05f-4ecc-aff8-62a1b7348b16 None admin] RBAC: Authorizing `identity:get_user(user_id=bf61353eb0614c70aa286ba9e0760696)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:57.006532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f6181-c05f-4ecc-aff8-62a1b7348b16 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:57.008343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 41/79] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:26:56 2022] GET /identity/v3/users/bf61353eb0614c70aa286ba9e0760696 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:57.012192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f6181-c05f-4ecc-aff8-62a1b7348b16 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.024323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.074591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e8dab-a661-4dd4-9d6e-0336d1fe925c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:57.080329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.112760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff03ef-44aa-4b6a-862c-125dca9a69dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.113326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff03ef-44aa-4b6a-862c-125dca9a69dc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.113608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff03ef-44aa-4b6a-862c-125dca9a69dc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.113885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff03ef-44aa-4b6a-862c-125dca9a69dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.114613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f6181-c05f-4ecc-aff8-62a1b7348b16 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:57.124379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff03ef-44aa-4b6a-862c-125dca9a69dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2eff03ef-44aa-4b6a-862c-125dca9a69dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:26:57.129547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:26:57.130375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:26:57.131299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 39/80] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:26:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:26:57.132130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff03ef-44aa-4b6a-862c-125dca9a69dc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.153145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc1eb6-2352-4d52-9858-409a3161af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.153754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc1eb6-2352-4d52-9858-409a3161af04 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.154042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc1eb6-2352-4d52-9858-409a3161af04 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.154313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc1eb6-2352-4d52-9858-409a3161af04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.226445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc1eb6-2352-4d52-9858-409a3161af04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:57.228089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc1eb6-2352-4d52-9858-409a3161af04 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:57.245420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff03ef-44aa-4b6a-862c-125dca9a69dc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:57.258781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.280901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376030e-4448-4679-b76c-9717fcc21f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.281571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376030e-4448-4679-b76c-9717fcc21f1a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.281885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376030e-4448-4679-b76c-9717fcc21f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.282160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376030e-4448-4679-b76c-9717fcc21f1a None admin] PATH_INFO: `/v3/users/ec83bbe15a0149e7887bb8e59789155b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.283373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376030e-4448-4679-b76c-9717fcc21f1a None admin] RBAC: Authorizing `identity:get_user(user_id=ec83bbe15a0149e7887bb8e59789155b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:57.284827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376030e-4448-4679-b76c-9717fcc21f1a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:57.286586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 40/81] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:26:57 2022] GET /identity/v3/users/ec83bbe15a0149e7887bb8e59789155b => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:57.287286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376030e-4448-4679-b76c-9717fcc21f1a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.298971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.334066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 42/82] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:57.334904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc1eb6-2352-4d52-9858-409a3161af04 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.391746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376030e-4448-4679-b76c-9717fcc21f1a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:57.426823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ca9b6-b59e-4fad-ad52-8ca9d9d06000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.427489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ca9b6-b59e-4fad-ad52-8ca9d9d06000 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.427773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ca9b6-b59e-4fad-ad52-8ca9d9d06000 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.428045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ca9b6-b59e-4fad-ad52-8ca9d9d06000 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.429218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ca9b6-b59e-4fad-ad52-8ca9d9d06000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:57.430665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ca9b6-b59e-4fad-ad52-8ca9d9d06000 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:57.432266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 41/83] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:26:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:57.433024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ca9b6-b59e-4fad-ad52-8ca9d9d06000 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.441216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc1eb6-2352-4d52-9858-409a3161af04 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:57.475103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc2fc6-9f50-46ed-a84a-a0a62f6fc430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.475950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2fc6-9f50-46ed-a84a-a0a62f6fc430 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.476058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2fc6-9f50-46ed-a84a-a0a62f6fc430 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.476260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2fc6-9f50-46ed-a84a-a0a62f6fc430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.481413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.511789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.533134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ca9b6-b59e-4fad-ad52-8ca9d9d06000 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:57.546285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc2fc6-9f50-46ed-a84a-a0a62f6fc430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:57.548385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc2fc6-9f50-46ed-a84a-a0a62f6fc430 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:57.569336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2300f-3ac8-4b53-b144-6a8cefe02b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.569947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2300f-3ac8-4b53-b144-6a8cefe02b29 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.570228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2300f-3ac8-4b53-b144-6a8cefe02b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.570499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2300f-3ac8-4b53-b144-6a8cefe02b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.571239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2300f-3ac8-4b53-b144-6a8cefe02b29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:57.571541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2300f-3ac8-4b53-b144-6a8cefe02b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:57.572880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2300f-3ac8-4b53-b144-6a8cefe02b29 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:57.580822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 42/84] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:26:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:57.581431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2300f-3ac8-4b53-b144-6a8cefe02b29 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.653131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 43/85] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:57.653131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc2fc6-9f50-46ed-a84a-a0a62f6fc430 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.680887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2300f-3ac8-4b53-b144-6a8cefe02b29 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:57.691659 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.715301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b4163-1ec8-4cc3-8f1b-ab3651b6e8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.715917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b4163-1ec8-4cc3-8f1b-ab3651b6e8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.716200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b4163-1ec8-4cc3-8f1b-ab3651b6e8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.716475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b4163-1ec8-4cc3-8f1b-ab3651b6e8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.717860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.752323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc2fc6-9f50-46ed-a84a-a0a62f6fc430 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:57.787098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b4163-1ec8-4cc3-8f1b-ab3651b6e8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:57.787638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b65152-6eb7-4dc8-b1bb-6e92a6c41f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.788284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b65152-6eb7-4dc8-b1bb-6e92a6c41f77 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.788561 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b4163-1ec8-4cc3-8f1b-ab3651b6e8c1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:57.788657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b65152-6eb7-4dc8-b1bb-6e92a6c41f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.788835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b65152-6eb7-4dc8-b1bb-6e92a6c41f77 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.789994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b65152-6eb7-4dc8-b1bb-6e92a6c41f77 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:57.791457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b65152-6eb7-4dc8-b1bb-6e92a6c41f77 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:57.793116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 44/86] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:26:57 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:57.793862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b65152-6eb7-4dc8-b1bb-6e92a6c41f77 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.890871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b65152-6eb7-4dc8-b1bb-6e92a6c41f77 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:57.892075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 43/87] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:57.895868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b4163-1ec8-4cc3-8f1b-ab3651b6e8c1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:57.907299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.926053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc5db-c179-4b23-8823-5da6b7514e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:57.926679 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc5db-c179-4b23-8823-5da6b7514e34 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:57.926961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc5db-c179-4b23-8823-5da6b7514e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:57.927270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cc5db-c179-4b23-8823-5da6b7514e34 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:57.927948 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cc5db-c179-4b23-8823-5da6b7514e34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:57.929382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cc5db-c179-4b23-8823-5da6b7514e34 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:57.939118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:57.951937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 45/88] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:26:57 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:26:57.955982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc5db-c179-4b23-8823-5da6b7514e34 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:58.005914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b4163-1ec8-4cc3-8f1b-ab3651b6e8c1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:58.049065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7902f7e-5613-4864-845a-9663546a7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:58.049770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902f7e-5613-4864-845a-9663546a7845 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:58.050095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902f7e-5613-4864-845a-9663546a7845 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:58.050420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902f7e-5613-4864-845a-9663546a7845 None admin] PATH_INFO: `/v3/users/ec83bbe15a0149e7887bb8e59789155b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:58.051550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7902f7e-5613-4864-845a-9663546a7845 None admin] RBAC: Authorizing `identity:get_user(user_id=ec83bbe15a0149e7887bb8e59789155b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:58.053123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7902f7e-5613-4864-845a-9663546a7845 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:58.059349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 44/89] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:26:57 2022] GET /identity/v3/users/ec83bbe15a0149e7887bb8e59789155b => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:58.059349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7902f7e-5613-4864-845a-9663546a7845 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:58.077717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cc5db-c179-4b23-8823-5da6b7514e34 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:58.121262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910f42a-598d-4277-bb12-732b7e3955c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:58.121262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f42a-598d-4277-bb12-732b7e3955c1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:58.121549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f42a-598d-4277-bb12-732b7e3955c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:58.121775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f42a-598d-4277-bb12-732b7e3955c1 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:58.123100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910f42a-598d-4277-bb12-732b7e3955c1 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:58.124607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910f42a-598d-4277-bb12-732b7e3955c1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:58.126321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 46/90] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:26:57 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:58.127705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910f42a-598d-4277-bb12-732b7e3955c1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:58.151751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:58.178971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7902f7e-5613-4864-845a-9663546a7845 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:58.209507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:58.239913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44676d6d-ea04-4aef-af12-5a21bca0acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:58.240723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44676d6d-ea04-4aef-af12-5a21bca0acc0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:58.241113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44676d6d-ea04-4aef-af12-5a21bca0acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:58.241530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44676d6d-ea04-4aef-af12-5a21bca0acc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:58.242392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44676d6d-ea04-4aef-af12-5a21bca0acc0 None admin] RBAC: Adding query filter params (role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34, user.id=ec83bbe15a0149e7887bb8e59789155b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:58.242709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44676d6d-ea04-4aef-af12-5a21bca0acc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:58.244478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44676d6d-ea04-4aef-af12-5a21bca0acc0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:58.251569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 45/91] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:26:58 2022] GET /identity/v3/role_assignments?user.id=ec83bbe15a0149e7887bb8e59789155b&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:58.252420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44676d6d-ea04-4aef-af12-5a21bca0acc0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:58.266386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910f42a-598d-4277-bb12-732b7e3955c1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:58.313997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2eddf-fff0-4378-b159-bea5cc3ac742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:58.314665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2eddf-fff0-4378-b159-bea5cc3ac742 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:58.314949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2eddf-fff0-4378-b159-bea5cc3ac742 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:58.315265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2eddf-fff0-4378-b159-bea5cc3ac742 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:58.316988 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2eddf-fff0-4378-b159-bea5cc3ac742 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:58.318072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2eddf-fff0-4378-b159-bea5cc3ac742 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:58.320372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 47/92] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:26:58 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:58.321685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2eddf-fff0-4378-b159-bea5cc3ac742 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:58.379440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44676d6d-ea04-4aef-af12-5a21bca0acc0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:58.448952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf023d2e-2fc6-4363-905f-8598349649ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:58.449641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf023d2e-2fc6-4363-905f-8598349649ab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:58.449959 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf023d2e-2fc6-4363-905f-8598349649ab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:58.450272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf023d2e-2fc6-4363-905f-8598349649ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:58.460091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2eddf-fff0-4378-b159-bea5cc3ac742 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:58.463924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:58.495370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:58.507147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab841-dd64-4a84-8cac-36093c147663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:58.508084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab841-dd64-4a84-8cac-36093c147663 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:58.508379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab841-dd64-4a84-8cac-36093c147663 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:58.508665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab841-dd64-4a84-8cac-36093c147663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:58.509477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bab841-dd64-4a84-8cac-36093c147663 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34, user.id=bf61353eb0614c70aa286ba9e0760696) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:58.509797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bab841-dd64-4a84-8cac-36093c147663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:58.512003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bab841-dd64-4a84-8cac-36093c147663 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:58.520844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 48/93] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:26:58 2022] GET /identity/v3/role_assignments?user.id=bf61353eb0614c70aa286ba9e0760696&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=c1429555635349208e8b2bd908436746 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:58.521973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab841-dd64-4a84-8cac-36093c147663 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:58.535730 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf023d2e-2fc6-4363-905f-8598349649ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:58.538489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf023d2e-2fc6-4363-905f-8598349649ab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:58.648512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab841-dd64-4a84-8cac-36093c147663 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:58.693005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a92f2-aebf-4528-872b-6dfa78efbcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:58.693688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a92f2-aebf-4528-872b-6dfa78efbcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:58.693978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a92f2-aebf-4528-872b-6dfa78efbcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:58.694261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a92f2-aebf-4528-872b-6dfa78efbcc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:58.695140 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a92f2-aebf-4528-872b-6dfa78efbcc9 None admin] RBAC: Adding query filter params (role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34, user.id=ec83bbe15a0149e7887bb8e59789155b) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:58.695467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a92f2-aebf-4528-872b-6dfa78efbcc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:58.697203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a92f2-aebf-4528-872b-6dfa78efbcc9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:58.704676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 49/94] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:26:58 2022] GET /identity/v3/role_assignments?user.id=ec83bbe15a0149e7887bb8e59789155b&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:58.781734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 46/95] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:26:58.787744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a92f2-aebf-4528-872b-6dfa78efbcc9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:58.853190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:58.903828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a92f2-aebf-4528-872b-6dfa78efbcc9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:58.941591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232a33d-044d-4e2c-9379-164502903b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:58.942252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a33d-044d-4e2c-9379-164502903b21 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:58.942540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a33d-044d-4e2c-9379-164502903b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:58.942822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a33d-044d-4e2c-9379-164502903b21 None admin] PATH_INFO: `/v3/projects/7eb9059575c1432f92fa522092def269` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:58.944082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232a33d-044d-4e2c-9379-164502903b21 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb9059575c1432f92fa522092def269)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:58.945542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232a33d-044d-4e2c-9379-164502903b21 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:58.947587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 50/96] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:26:58 2022] GET /identity/v3/projects/7eb9059575c1432f92fa522092def269 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:26:58.954172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf023d2e-2fc6-4363-905f-8598349649ab None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:26:59.019474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:26:59.113835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf023d2e-2fc6-4363-905f-8598349649ab None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:26:59.165550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829df5f3-9e99-49ab-9e56-9522743e3721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:26:59.166178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df5f3-9e99-49ab-9e56-9522743e3721 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:26:59.166459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df5f3-9e99-49ab-9e56-9522743e3721 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:26:59.166731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829df5f3-9e99-49ab-9e56-9522743e3721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:26:59.167553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829df5f3-9e99-49ab-9e56-9522743e3721 None admin] RBAC: Adding query filter params (role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=7eb9059575c1432f92fa522092def269, user.id=ec83bbe15a0149e7887bb8e59789155b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:26:59.167855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829df5f3-9e99-49ab-9e56-9522743e3721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:26:59.169291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829df5f3-9e99-49ab-9e56-9522743e3721 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:26:59.179275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 47/97] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:26:58 2022] GET /identity/v3/role_assignments?user.id=ec83bbe15a0149e7887bb8e59789155b&scope.project.id=7eb9059575c1432f92fa522092def269&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:00.896706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35acdc-cd49-4a7d-8eb2-751d07d434d0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:00.897208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35acdc-cd49-4a7d-8eb2-751d07d434d0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:00.897286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35acdc-cd49-4a7d-8eb2-751d07d434d0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:00.898585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 51/98] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:00.903884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f80bbf-12ae-4cda-b3eb-9e9299546d00 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:00.904306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f80bbf-12ae-4cda-b3eb-9e9299546d00 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:00.904403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec643e-98cc-492a-b77b-80af0f096e56 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:00.904484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f80bbf-12ae-4cda-b3eb-9e9299546d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:00.904671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec643e-98cc-492a-b77b-80af0f096e56 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:00.904937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec643e-98cc-492a-b77b-80af0f096e56 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:00.906325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 52/99] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:00.911560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cc5a1-f9a3-4150-aca0-607b36f0d5c3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:00.911909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cc5a1-f9a3-4150-aca0-607b36f0d5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:00.912192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cc5a1-f9a3-4150-aca0-607b36f0d5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:00.928196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-87f80bbf-12ae-4cda-b3eb-9e9299546d00 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:00.929382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-87f80bbf-12ae-4cda-b3eb-9e9299546d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:00.943053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b30cc5a1-f9a3-4150-aca0-607b36f0d5c3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:00.944234 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b30cc5a1-f9a3-4150-aca0-607b36f0d5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:01.045846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 53/100] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:01.065031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 48/101] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:01.072269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902b481-82c6-4de2-a7fd-af8a65d150f1 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.072558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902b481-82c6-4de2-a7fd-af8a65d150f1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.072840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902b481-82c6-4de2-a7fd-af8a65d150f1 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.074370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 54/102] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:01.079827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c649-8fda-4961-b205-0cf5c46c3cef None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.080117 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c649-8fda-4961-b205-0cf5c46c3cef None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.080395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5c649-8fda-4961-b205-0cf5c46c3cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.084580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902b481-82c6-4de2-a7fd-af8a65d150f1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:01.108748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e6b5c649-8fda-4961-b205-0cf5c46c3cef None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:01.109961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e6b5c649-8fda-4961-b205-0cf5c46c3cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:01.167663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:01.193148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:01.210600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 49/103] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:01.211615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5c649-8fda-4961-b205-0cf5c46c3cef None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:01.280435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902b481-82c6-4de2-a7fd-af8a65d150f1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:01.317475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34da8c-d1ac-4088-899e-b3177306f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:01.318035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34da8c-d1ac-4088-899e-b3177306f556 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.318317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34da8c-d1ac-4088-899e-b3177306f556 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.318586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34da8c-d1ac-4088-899e-b3177306f556 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.330700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34da8c-d1ac-4088-899e-b3177306f556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8b34da8c-d1ac-4088-899e-b3177306f556 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:01.337564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:01.338401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:01.339162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 55/104] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:01.339804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34da8c-d1ac-4088-899e-b3177306f556 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:01.361775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5c649-8fda-4961-b205-0cf5c46c3cef None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:01.445671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34da8c-d1ac-4088-899e-b3177306f556 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:01.459730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:01.463681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d74c-2b32-4138-9589-bb0c5e0cae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:01.464554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d74c-2b32-4138-9589-bb0c5e0cae03 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.464995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d74c-2b32-4138-9589-bb0c5e0cae03 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.465419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d74c-2b32-4138-9589-bb0c5e0cae03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.481201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd30f96-f2da-4f19-ac79-0b18d0c5c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:01.481965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30f96-f2da-4f19-ac79-0b18d0c5c7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.482347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30f96-f2da-4f19-ac79-0b18d0c5c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.482714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30f96-f2da-4f19-ac79-0b18d0c5c7f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.484175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd30f96-f2da-4f19-ac79-0b18d0c5c7f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:01.485962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd30f96-f2da-4f19-ac79-0b18d0c5c7f8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:01.487722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 56/105] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:01.487921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36d74c-2b32-4138-9589-bb0c5e0cae03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:01.488666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd30f96-f2da-4f19-ac79-0b18d0c5c7f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7f36d74c-2b32-4138-9589-bb0c5e0cae03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:01.502530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:01.503521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:01.504256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:01.506856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 50/106] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:01.507816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d74c-2b32-4138-9589-bb0c5e0cae03 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:01.554039 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:01.647193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd30f96-f2da-4f19-ac79-0b18d0c5c7f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:01.710956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d74c-2b32-4138-9589-bb0c5e0cae03 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:01.712980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1d9e9-8e3a-41a5-a276-58eb8c5c7193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:01.713607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1d9e9-8e3a-41a5-a276-58eb8c5c7193 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.713888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1d9e9-8e3a-41a5-a276-58eb8c5c7193 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.714162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1d9e9-8e3a-41a5-a276-58eb8c5c7193 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.714881 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1d9e9-8e3a-41a5-a276-58eb8c5c7193 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:01.715221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1d9e9-8e3a-41a5-a276-58eb8c5c7193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:01.716754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1d9e9-8e3a-41a5-a276-58eb8c5c7193 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:01.730973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 57/107] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:01.735851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1d9e9-8e3a-41a5-a276-58eb8c5c7193 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:01.755673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d7257-06a1-4a7e-a46a-d764f0811ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:01.755673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d7257-06a1-4a7e-a46a-d764f0811ee2 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.755673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d7257-06a1-4a7e-a46a-d764f0811ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.755673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d7257-06a1-4a7e-a46a-d764f0811ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.756046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d7257-06a1-4a7e-a46a-d764f0811ee2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:01.759016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d7257-06a1-4a7e-a46a-d764f0811ee2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:01.786181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:01.793847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 51/108] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:27:01 2022] POST /identity/v3/projects => generated 302 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:01.795503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22974-4434-45fb-ad33-9350784fc586 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.795791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22974-4434-45fb-ad33-9350784fc586 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.796063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22974-4434-45fb-ad33-9350784fc586 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.798162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 52/109] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:01.799205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22974-4434-45fb-ad33-9350784fc586 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:01.900735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1d9e9-8e3a-41a5-a276-58eb8c5c7193 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:01.906862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:01.941281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bebe19-a0b6-46c3-ab31-a08069936842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:01.941922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bebe19-a0b6-46c3-ab31-a08069936842 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.942205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bebe19-a0b6-46c3-ab31-a08069936842 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.942483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bebe19-a0b6-46c3-ab31-a08069936842 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.943453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bebe19-a0b6-46c3-ab31-a08069936842 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:01.943767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bebe19-a0b6-46c3-ab31-a08069936842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:01.944337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22974-4434-45fb-ad33-9350784fc586 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:01.945163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bebe19-a0b6-46c3-ab31-a08069936842 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:01.956210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 58/110] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:01.957562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd485e61-9105-4570-b3bd-a6bb9455fbf1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.957856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd485e61-9105-4570-b3bd-a6bb9455fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.958135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd485e61-9105-4570-b3bd-a6bb9455fbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:01.978177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bd485e61-9105-4570-b3bd-a6bb9455fbf1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:01.979623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bd485e61-9105-4570-b3bd-a6bb9455fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:01.993568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ef76b-028c-4ebd-8ff7-d6b7ba865dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:01.994602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ef76b-028c-4ebd-8ff7-d6b7ba865dad None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:01.994889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ef76b-028c-4ebd-8ff7-d6b7ba865dad None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:01.995191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ef76b-028c-4ebd-8ff7-d6b7ba865dad None admin] PATH_INFO: `/v3/users/ab56eabd692d401a8346ae05c4a55a01` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.014919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ef76b-028c-4ebd-8ff7-d6b7ba865dad None admin] RBAC: Authorizing `identity:get_user(user_id=ab56eabd692d401a8346ae05c4a55a01)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:02.017165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ef76b-028c-4ebd-8ff7-d6b7ba865dad None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:02.019248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 53/111] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:01 2022] GET /identity/v3/users/ab56eabd692d401a8346ae05c4a55a01 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:02.020465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77417ee2-aaa9-4116-87b6-d93bda3dec92 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.020750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77417ee2-aaa9-4116-87b6-d93bda3dec92 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.021023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77417ee2-aaa9-4116-87b6-d93bda3dec92 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.022414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 54/112] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:02.022938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77417ee2-aaa9-4116-87b6-d93bda3dec92 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:02.069813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 59/113] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:02.071163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd485e61-9105-4570-b3bd-a6bb9455fbf1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:02.124814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:02.147955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77417ee2-aaa9-4116-87b6-d93bda3dec92 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:02.188456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5291a-b29e-40bb-9800-a8435be48a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:02.189214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5291a-b29e-40bb-9800-a8435be48a80 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.189500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5291a-b29e-40bb-9800-a8435be48a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.189918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5291a-b29e-40bb-9800-a8435be48a80 None admin] PATH_INFO: `/v3/users/ec83bbe15a0149e7887bb8e59789155b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.191285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5291a-b29e-40bb-9800-a8435be48a80 None admin] RBAC: Authorizing `identity:get_user(user_id=ec83bbe15a0149e7887bb8e59789155b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:02.192777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5291a-b29e-40bb-9800-a8435be48a80 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:02.194928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 55/114] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:02 2022] GET /identity/v3/users/ec83bbe15a0149e7887bb8e59789155b => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:02.196193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a68988-38d7-409d-acc2-6dfd0ae7e7f7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.196482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a68988-38d7-409d-acc2-6dfd0ae7e7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.196757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a68988-38d7-409d-acc2-6dfd0ae7e7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.206251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:02.214143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd485e61-9105-4570-b3bd-a6bb9455fbf1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:02.220576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b4a68988-38d7-409d-acc2-6dfd0ae7e7f7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:02.221832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b4a68988-38d7-409d-acc2-6dfd0ae7e7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:02.258874 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dcd2d-cd7a-40c1-ac65-0d4ed49ac9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:02.259781 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dcd2d-cd7a-40c1-ac65-0d4ed49ac9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.260065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dcd2d-cd7a-40c1-ac65-0d4ed49ac9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.260741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dcd2d-cd7a-40c1-ac65-0d4ed49ac9a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.311792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 56/115] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:02.313341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a68988-38d7-409d-acc2-6dfd0ae7e7f7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:02.360579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dcd2d-cd7a-40c1-ac65-0d4ed49ac9a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:02.362910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dcd2d-cd7a-40c1-ac65-0d4ed49ac9a2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:02.405742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:02.422819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a68988-38d7-409d-acc2-6dfd0ae7e7f7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:02.458926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50578795-fae9-413d-871a-689b1a0a78dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:02.459521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50578795-fae9-413d-871a-689b1a0a78dc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.459808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50578795-fae9-413d-871a-689b1a0a78dc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.460079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50578795-fae9-413d-871a-689b1a0a78dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.462135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:02.477220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50578795-fae9-413d-871a-689b1a0a78dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:02.480425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 60/116] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:02.481261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dcd2d-cd7a-40c1-ac65-0d4ed49ac9a2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-50578795-fae9-413d-871a-689b1a0a78dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:02.483047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:02.483865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:02.484633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:02.487245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 57/117] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:02.488582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780efbc-c0cf-468a-b8a2-5b2288db33cf None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.489221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780efbc-c0cf-468a-b8a2-5b2288db33cf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.489838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780efbc-c0cf-468a-b8a2-5b2288db33cf None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.491326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 58/118] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:02.496056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780efbc-c0cf-468a-b8a2-5b2288db33cf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:02.594869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dcd2d-cd7a-40c1-ac65-0d4ed49ac9a2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:02.612349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780efbc-c0cf-468a-b8a2-5b2288db33cf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:02.636324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46745313-b268-49ef-9bd3-4955b944c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:02.637033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46745313-b268-49ef-9bd3-4955b944c7bf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.637304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46745313-b268-49ef-9bd3-4955b944c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.637573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46745313-b268-49ef-9bd3-4955b944c7bf None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.638748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46745313-b268-49ef-9bd3-4955b944c7bf None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:02.640230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46745313-b268-49ef-9bd3-4955b944c7bf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:02.642125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 61/119] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:02 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:02.642800 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46745313-b268-49ef-9bd3-4955b944c7bf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:02.651116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:02.656081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a1df4-efb0-41fc-895d-420dbbee4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:02.656760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a1df4-efb0-41fc-895d-420dbbee4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.657068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a1df4-efb0-41fc-895d-420dbbee4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.657317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a1df4-efb0-41fc-895d-420dbbee4fe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.668593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a1df4-efb0-41fc-895d-420dbbee4fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a66a1df4-efb0-41fc-895d-420dbbee4fe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:02.674919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:02.676892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 59/120] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:02.678140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a1df4-efb0-41fc-895d-420dbbee4fe0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:02.745581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:02.761240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46745313-b268-49ef-9bd3-4955b944c7bf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:02.796068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab36b85-f9d8-40c2-bd7f-f9cd56ce4d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:02.796710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab36b85-f9d8-40c2-bd7f-f9cd56ce4d79 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.796995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab36b85-f9d8-40c2-bd7f-f9cd56ce4d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.797344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab36b85-f9d8-40c2-bd7f-f9cd56ce4d79 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.798587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab36b85-f9d8-40c2-bd7f-f9cd56ce4d79 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:02.799387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a1df4-efb0-41fc-895d-420dbbee4fe0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:02.800059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab36b85-f9d8-40c2-bd7f-f9cd56ce4d79 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:02.801697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 62/121] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:02 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:02.802809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3b01e-4caa-4f2f-813b-7358ee145d13 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.803113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3b01e-4caa-4f2f-813b-7358ee145d13 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.803391 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3b01e-4caa-4f2f-813b-7358ee145d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.821083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b2e3b01e-4caa-4f2f-813b-7358ee145d13 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:02.822517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b2e3b01e-4caa-4f2f-813b-7358ee145d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:02.842275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e2c9-5ef2-4dee-be99-7dfe2d31b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:02.843220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e2c9-5ef2-4dee-be99-7dfe2d31b009 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:02.843690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e2c9-5ef2-4dee-be99-7dfe2d31b009 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:02.844693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8e2c9-5ef2-4dee-be99-7dfe2d31b009 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:02.845602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8e2c9-5ef2-4dee-be99-7dfe2d31b009 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:02.846090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8e2c9-5ef2-4dee-be99-7dfe2d31b009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:02.847759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8e2c9-5ef2-4dee-be99-7dfe2d31b009 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:02.857002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 60/122] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:02.858028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e2c9-5ef2-4dee-be99-7dfe2d31b009 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:02.902085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 63/123] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:02.903075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3b01e-4caa-4f2f-813b-7358ee145d13 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:02.905358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:02.987187 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8e2c9-5ef2-4dee-be99-7dfe2d31b009 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.004197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:03.010080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3b01e-4caa-4f2f-813b-7358ee145d13 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.024410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df401cf7-3ea6-4d12-bb72-cd095d66fe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.025090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df401cf7-3ea6-4d12-bb72-cd095d66fe2a None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.025374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df401cf7-3ea6-4d12-bb72-cd095d66fe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.025653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df401cf7-3ea6-4d12-bb72-cd095d66fe2a None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/users/ec83bbe15a0149e7887bb8e59789155b/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.027644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df401cf7-3ea6-4d12-bb72-cd095d66fe2a None admin] RBAC: Authorizing `identity:create_grant(project_id=e63992ad2ad44ebd85dc7df2b2522b34, user_id=ec83bbe15a0149e7887bb8e59789155b, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:03.029088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df401cf7-3ea6-4d12-bb72-cd095d66fe2a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:03.044350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 61/124] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:27:02 2022] PUT /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/users/ec83bbe15a0149e7887bb8e59789155b/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:03.053218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93f9f-841b-419d-b04a-95a565fd438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.053883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93f9f-841b-419d-b04a-95a565fd438f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.054167 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93f9f-841b-419d-b04a-95a565fd438f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.054442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93f9f-841b-419d-b04a-95a565fd438f None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.055246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93f9f-841b-419d-b04a-95a565fd438f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:03.055555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93f9f-841b-419d-b04a-95a565fd438f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:03.056541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df401cf7-3ea6-4d12-bb72-cd095d66fe2a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.057019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93f9f-841b-419d-b04a-95a565fd438f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:03.067654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 64/125] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:03.073288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93f9f-841b-419d-b04a-95a565fd438f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.166060 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:03.198021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df401cf7-3ea6-4d12-bb72-cd095d66fe2a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.222721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93f9f-841b-419d-b04a-95a565fd438f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.262180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38cb5-7c3a-4bc5-bdd9-2f69fe29bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.262723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38cb5-7c3a-4bc5-bdd9-2f69fe29bc94 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.263024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38cb5-7c3a-4bc5-bdd9-2f69fe29bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.263295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38cb5-7c3a-4bc5-bdd9-2f69fe29bc94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.264189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38cb5-7c3a-4bc5-bdd9-2f69fe29bc94 None admin] RBAC: Adding query filter params (role.id=29d5cce45377405291fc52f29711ed58, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34, user.id=ab56eabd692d401a8346ae05c4a55a01) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:03.264498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38cb5-7c3a-4bc5-bdd9-2f69fe29bc94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:03.265945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38cb5-7c3a-4bc5-bdd9-2f69fe29bc94 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:03.272142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 62/126] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:03 2022] GET /identity/v3/role_assignments?user.id=ab56eabd692d401a8346ae05c4a55a01&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=29d5cce45377405291fc52f29711ed58 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:03.272901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38cb5-7c3a-4bc5-bdd9-2f69fe29bc94 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.286665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5933a44-87d4-4652-93d6-8fa4d753f8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.288315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5933a44-87d4-4652-93d6-8fa4d753f8cf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.289313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5933a44-87d4-4652-93d6-8fa4d753f8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.289847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5933a44-87d4-4652-93d6-8fa4d753f8cf None admin] PATH_INFO: `/v3/users/ec83bbe15a0149e7887bb8e59789155b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.291835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5933a44-87d4-4652-93d6-8fa4d753f8cf None admin] RBAC: Authorizing `identity:get_user(user_id=ec83bbe15a0149e7887bb8e59789155b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:03.294370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5933a44-87d4-4652-93d6-8fa4d753f8cf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:03.298413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 65/127] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:03 2022] GET /identity/v3/users/ec83bbe15a0149e7887bb8e59789155b => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:03.299590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5933a44-87d4-4652-93d6-8fa4d753f8cf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.333341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:03.402846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38cb5-7c3a-4bc5-bdd9-2f69fe29bc94 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.429900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5933a44-87d4-4652-93d6-8fa4d753f8cf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.441450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730276b1-c212-4c7b-94f3-7ee0602b3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.442361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730276b1-c212-4c7b-94f3-7ee0602b3ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.442842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730276b1-c212-4c7b-94f3-7ee0602b3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.443334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730276b1-c212-4c7b-94f3-7ee0602b3ab4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.455852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730276b1-c212-4c7b-94f3-7ee0602b3ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-730276b1-c212-4c7b-94f3-7ee0602b3ab4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:03.462093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:03.462925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:03.463709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:03.465077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:03.467306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 63/128] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:03.468868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730276b1-c212-4c7b-94f3-7ee0602b3ab4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.474043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046879-fd1c-4d5f-90b0-7631b10cd570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.474711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046879-fd1c-4d5f-90b0-7631b10cd570 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.475031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046879-fd1c-4d5f-90b0-7631b10cd570 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.475309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046879-fd1c-4d5f-90b0-7631b10cd570 None admin] PATH_INFO: `/v3/users/bf61353eb0614c70aa286ba9e0760696` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.476628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24046879-fd1c-4d5f-90b0-7631b10cd570 None admin] RBAC: Authorizing `identity:get_user(user_id=bf61353eb0614c70aa286ba9e0760696)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:03.478202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24046879-fd1c-4d5f-90b0-7631b10cd570 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:03.480751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 66/129] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:03 2022] GET /identity/v3/users/bf61353eb0614c70aa286ba9e0760696 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:03.481085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046879-fd1c-4d5f-90b0-7631b10cd570 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.597154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:03.600263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730276b1-c212-4c7b-94f3-7ee0602b3ab4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.600652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046879-fd1c-4d5f-90b0-7631b10cd570 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.641003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f94a28-a620-4dc4-9702-67275dbaec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.642215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f94a28-a620-4dc4-9702-67275dbaec81 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.642501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f94a28-a620-4dc4-9702-67275dbaec81 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.642777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f94a28-a620-4dc4-9702-67275dbaec81 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.643585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f94a28-a620-4dc4-9702-67275dbaec81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:03.643886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f94a28-a620-4dc4-9702-67275dbaec81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:03.645504 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f94a28-a620-4dc4-9702-67275dbaec81 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:03.647593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6566cc4-0274-4dac-ae07-c2dcb5975e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.648584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6566cc4-0274-4dac-ae07-c2dcb5975e3c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.649060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6566cc4-0274-4dac-ae07-c2dcb5975e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.649543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6566cc4-0274-4dac-ae07-c2dcb5975e3c None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.650933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6566cc4-0274-4dac-ae07-c2dcb5975e3c None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:03.652656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6566cc4-0274-4dac-ae07-c2dcb5975e3c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:03.654808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 67/130] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:03.655213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 64/131] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:03 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:03.660103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6566cc4-0274-4dac-ae07-c2dcb5975e3c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.660245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f94a28-a620-4dc4-9702-67275dbaec81 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.738083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:03.778613 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6566cc4-0274-4dac-ae07-c2dcb5975e3c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.810435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f94a28-a620-4dc4-9702-67275dbaec81 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:03.817912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536963c-bc91-4419-bbb5-ee7bfdc9268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.818823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536963c-bc91-4419-bbb5-ee7bfdc9268d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.819395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536963c-bc91-4419-bbb5-ee7bfdc9268d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.819921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536963c-bc91-4419-bbb5-ee7bfdc9268d None admin] PATH_INFO: `/v3/users/ec83bbe15a0149e7887bb8e59789155b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.821463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536963c-bc91-4419-bbb5-ee7bfdc9268d None admin] RBAC: Authorizing `identity:get_user(user_id=ec83bbe15a0149e7887bb8e59789155b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:03.823214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536963c-bc91-4419-bbb5-ee7bfdc9268d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:03.825409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 65/132] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:03 2022] GET /identity/v3/users/ec83bbe15a0149e7887bb8e59789155b => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:03.826546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536963c-bc91-4419-bbb5-ee7bfdc9268d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.871386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949aa24-9486-48b6-a37f-4e29833f81a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:03.871960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949aa24-9486-48b6-a37f-4e29833f81a3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:03.872244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949aa24-9486-48b6-a37f-4e29833f81a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:03.872530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949aa24-9486-48b6-a37f-4e29833f81a3 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:03.873725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949aa24-9486-48b6-a37f-4e29833f81a3 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:03.875298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949aa24-9486-48b6-a37f-4e29833f81a3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:03.877589 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 68/133] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:03 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:03.878481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949aa24-9486-48b6-a37f-4e29833f81a3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:03.884300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:03.988053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949aa24-9486-48b6-a37f-4e29833f81a3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:04.023965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:04.047016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96f41c-af2c-4965-974d-2e1b9d23cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:04.047016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96f41c-af2c-4965-974d-2e1b9d23cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:04.047016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96f41c-af2c-4965-974d-2e1b9d23cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:04.047016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96f41c-af2c-4965-974d-2e1b9d23cbb3 None admin] PATH_INFO: `/v3/projects/7eb9059575c1432f92fa522092def269` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:04.048379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96f41c-af2c-4965-974d-2e1b9d23cbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb9059575c1432f92fa522092def269)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:04.050805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96f41c-af2c-4965-974d-2e1b9d23cbb3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:04.057284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 69/134] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:03 2022] GET /identity/v3/projects/7eb9059575c1432f92fa522092def269 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:04.057873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96f41c-af2c-4965-974d-2e1b9d23cbb3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:04.119494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536963c-bc91-4419-bbb5-ee7bfdc9268d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:04.207007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313763d-8f7f-4b67-9743-1dd96b824b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:04.207007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313763d-8f7f-4b67-9743-1dd96b824b2a None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:04.207007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313763d-8f7f-4b67-9743-1dd96b824b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:04.207007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313763d-8f7f-4b67-9743-1dd96b824b2a None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/users/ec83bbe15a0149e7887bb8e59789155b/roles/22759f25d96f4063a7d10f7048d7b3bd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:04.211009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313763d-8f7f-4b67-9743-1dd96b824b2a None admin] RBAC: Authorizing `identity:create_grant(project_id=e63992ad2ad44ebd85dc7df2b2522b34, user_id=ec83bbe15a0149e7887bb8e59789155b, role_id=22759f25d96f4063a7d10f7048d7b3bd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:04.211009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313763d-8f7f-4b67-9743-1dd96b824b2a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:04.237418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 66/135] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:27:03 2022] PUT /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/users/ec83bbe15a0149e7887bb8e59789155b/roles/22759f25d96f4063a7d10f7048d7b3bd => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:04.238815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313763d-8f7f-4b67-9743-1dd96b824b2a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:04.333120 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96f41c-af2c-4965-974d-2e1b9d23cbb3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:04.451899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079af53b-d12a-4865-8615-877c1bfcb45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:04.452856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af53b-d12a-4865-8615-877c1bfcb45a None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:04.452856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af53b-d12a-4865-8615-877c1bfcb45a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:04.454248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af53b-d12a-4865-8615-877c1bfcb45a None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/users/bf61353eb0614c70aa286ba9e0760696/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:04.463567 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079af53b-d12a-4865-8615-877c1bfcb45a None admin] RBAC: Authorizing `identity:create_grant(project_id=e63992ad2ad44ebd85dc7df2b2522b34, user_id=bf61353eb0614c70aa286ba9e0760696, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:04.464818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079af53b-d12a-4865-8615-877c1bfcb45a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:04.473282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:04.483729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 70/136] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:27:04 2022] PUT /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/users/bf61353eb0614c70aa286ba9e0760696/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:04.483922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313763d-8f7f-4b67-9743-1dd96b824b2a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:04.485809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33918533-cbc2-4b5c-a1e5-938c3add3c07 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:04.486383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33918533-cbc2-4b5c-a1e5-938c3add3c07 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:04.486961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33918533-cbc2-4b5c-a1e5-938c3add3c07 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:04.491952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 71/137] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:04.509007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0ff2-baf7-4abc-bd75-b10277954e5a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:04.509328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0ff2-baf7-4abc-bd75-b10277954e5a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:04.509633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c0ff2-baf7-4abc-bd75-b10277954e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:04.559862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1a5e-c29c-42a1-b3e5-46d42a7979bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:04.560566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1a5e-c29c-42a1-b3e5-46d42a7979bc None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:04.560846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1a5e-c29c-42a1-b3e5-46d42a7979bc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:04.563377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1a5e-c29c-42a1-b3e5-46d42a7979bc None admin] PATH_INFO: `/v3/projects/7eb9059575c1432f92fa522092def269/users/ec83bbe15a0149e7887bb8e59789155b/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:04.563649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c31c0ff2-baf7-4abc-bd75-b10277954e5a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:04.564728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded1a5e-c29c-42a1-b3e5-46d42a7979bc None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb9059575c1432f92fa522092def269, user_id=ec83bbe15a0149e7887bb8e59789155b, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:04.565095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c31c0ff2-baf7-4abc-bd75-b10277954e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:04.566192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded1a5e-c29c-42a1-b3e5-46d42a7979bc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:04.601811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 67/138] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:27:04 2022] PUT /identity/v3/projects/7eb9059575c1432f92fa522092def269/users/ec83bbe15a0149e7887bb8e59789155b/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:04.747103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:04.762907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 72/139] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 04 04:27:04.790180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1a5e-c29c-42a1-b3e5-46d42a7979bc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:04.921750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1a5e-c29c-42a1-b3e5-46d42a7979bc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:04.973462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28226217-950c-44d0-b94f-7733e5579896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:04.974158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28226217-950c-44d0-b94f-7733e5579896 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:04.974453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28226217-950c-44d0-b94f-7733e5579896 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:04.974726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28226217-950c-44d0-b94f-7733e5579896 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:04.975952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28226217-950c-44d0-b94f-7733e5579896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:04.977390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28226217-950c-44d0-b94f-7733e5579896 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:04.979068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 68/140] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:04.984561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0ff2-baf7-4abc-bd75-b10277954e5a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:05.091782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c0ff2-baf7-4abc-bd75-b10277954e5a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:05.129852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568da44-f6bd-461b-9818-cef31d40bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:05.130486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568da44-f6bd-461b-9818-cef31d40bc8a None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:05.130769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568da44-f6bd-461b-9818-cef31d40bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:05.131085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568da44-f6bd-461b-9818-cef31d40bc8a None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:05.131786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568da44-f6bd-461b-9818-cef31d40bc8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:05.133227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568da44-f6bd-461b-9818-cef31d40bc8a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:05.156371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 73/141] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:04 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:05.564081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf0ba2-043d-4a09-8268-656a408b8720 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:05.564785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf0ba2-043d-4a09-8268-656a408b8720 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:05.564785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf0ba2-043d-4a09-8268-656a408b8720 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:05.566139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 69/142] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:05.578388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393b53-febf-4e05-9f5e-dc42be361200 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:05.579561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393b53-febf-4e05-9f5e-dc42be361200 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:05.580101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13393b53-febf-4e05-9f5e-dc42be361200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:05.603997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-13393b53-febf-4e05-9f5e-dc42be361200 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:05.605795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-13393b53-febf-4e05-9f5e-dc42be361200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:05.659016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:05.693317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 74/143] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:05.719372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf0ba2-043d-4a09-8268-656a408b8720 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:05.767804 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:05.878422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf0ba2-043d-4a09-8268-656a408b8720 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:05.922184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4b15a-1b96-438f-8829-1c4c7a560508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:05.922919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b15a-1b96-438f-8829-1c4c7a560508 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:05.923224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b15a-1b96-438f-8829-1c4c7a560508 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:05.923501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4b15a-1b96-438f-8829-1c4c7a560508 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:05.940923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4b15a-1b96-438f-8829-1c4c7a560508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ebf4b15a-1b96-438f-8829-1c4c7a560508 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:05.946316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:05.947224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:05.948068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 70/144] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:05.955485 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13393b53-febf-4e05-9f5e-dc42be361200 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:06.076061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13393b53-febf-4e05-9f5e-dc42be361200 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:06.122224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057429bf-e60b-4d58-9496-63b722e9563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:06.123714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057429bf-e60b-4d58-9496-63b722e9563d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:06.124309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057429bf-e60b-4d58-9496-63b722e9563d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:06.124787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057429bf-e60b-4d58-9496-63b722e9563d None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:06.126471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057429bf-e60b-4d58-9496-63b722e9563d None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:06.127155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057429bf-e60b-4d58-9496-63b722e9563d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:06.128903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057429bf-e60b-4d58-9496-63b722e9563d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:06.138373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 75/145] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:06.144380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4b15a-1b96-438f-8829-1c4c7a560508 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:06.273139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:06.291874 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4b15a-1b96-438f-8829-1c4c7a560508 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:06.321345 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b0f6d-6992-4c07-82d0-413cfd989bec None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:06.321653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b0f6d-6992-4c07-82d0-413cfd989bec None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:06.321931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b0f6d-6992-4c07-82d0-413cfd989bec None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:06.324133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 76/146] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:06.329138 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb7f1d-2de0-4666-b258-28aa1b649792 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:06.329500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb7f1d-2de0-4666-b258-28aa1b649792 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:06.329872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb7f1d-2de0-4666-b258-28aa1b649792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:06.335126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3d15c-cf3b-4869-b488-0798e8cc3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:06.336013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3d15c-cf3b-4869-b488-0798e8cc3005 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:06.336471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3d15c-cf3b-4869-b488-0798e8cc3005 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:06.336916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3d15c-cf3b-4869-b488-0798e8cc3005 None admin] PATH_INFO: `/v3/users/ec83bbe15a0149e7887bb8e59789155b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:06.338249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3d15c-cf3b-4869-b488-0798e8cc3005 None admin] RBAC: Authorizing `identity:get_user(user_id=ec83bbe15a0149e7887bb8e59789155b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:06.339897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3d15c-cf3b-4869-b488-0798e8cc3005 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:06.341671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 71/147] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:06 2022] GET /identity/v3/users/ec83bbe15a0149e7887bb8e59789155b => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:06.349625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3d15c-cf3b-4869-b488-0798e8cc3005 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:06.361682 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-abeb7f1d-2de0-4666-b258-28aa1b649792 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:06.364882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-abeb7f1d-2de0-4666-b258-28aa1b649792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:06.405524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:06.487093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 77/148] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:06.541855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb7f1d-2de0-4666-b258-28aa1b649792 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:06.544699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3d15c-cf3b-4869-b488-0798e8cc3005 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:06.620632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a1412-a8cf-496f-8c0d-efb209cc4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:06.621360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1412-a8cf-496f-8c0d-efb209cc4587 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:06.621619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1412-a8cf-496f-8c0d-efb209cc4587 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:06.621895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1412-a8cf-496f-8c0d-efb209cc4587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:06.673551 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:06.740589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a1412-a8cf-496f-8c0d-efb209cc4587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:06.742081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a1412-a8cf-496f-8c0d-efb209cc4587 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:06.797315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb7f1d-2de0-4666-b258-28aa1b649792 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:06.859547 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa579a-a0f2-4772-b29d-31e0c31b0b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:06.860279 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa579a-a0f2-4772-b29d-31e0c31b0b86 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:06.860591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa579a-a0f2-4772-b29d-31e0c31b0b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:06.860900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa579a-a0f2-4772-b29d-31e0c31b0b86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:06.876568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa579a-a0f2-4772-b29d-31e0c31b0b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-75fa579a-a0f2-4772-b29d-31e0c31b0b86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:06.881653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:06.882474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:06.883235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 78/149] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:06.889756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa579a-a0f2-4772-b29d-31e0c31b0b86 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:06.899357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 72/150] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:06.906009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a1412-a8cf-496f-8c0d-efb209cc4587 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:06.935859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:07.024308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:07.030603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa579a-a0f2-4772-b29d-31e0c31b0b86 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:07.082701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a1412-a8cf-496f-8c0d-efb209cc4587 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:07.089110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcc64d-6dea-4775-8b85-a985d6cfaf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:07.089750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcc64d-6dea-4775-8b85-a985d6cfaf4e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:07.090035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcc64d-6dea-4775-8b85-a985d6cfaf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:07.090312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcc64d-6dea-4775-8b85-a985d6cfaf4e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:07.091137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcc64d-6dea-4775-8b85-a985d6cfaf4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:07.091449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcc64d-6dea-4775-8b85-a985d6cfaf4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:07.092852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcc64d-6dea-4775-8b85-a985d6cfaf4e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:07.110886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 79/151] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:07.119526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcc64d-6dea-4775-8b85-a985d6cfaf4e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:07.121907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b37f1-ee38-4de6-974b-d9c55b4f0d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:07.123015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b37f1-ee38-4de6-974b-d9c55b4f0d97 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:07.123510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b37f1-ee38-4de6-974b-d9c55b4f0d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:07.123969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b37f1-ee38-4de6-974b-d9c55b4f0d97 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:07.125472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b37f1-ee38-4de6-974b-d9c55b4f0d97 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:07.128070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b37f1-ee38-4de6-974b-d9c55b4f0d97 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:07.130244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 73/152] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:06 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:07.136144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b37f1-ee38-4de6-974b-d9c55b4f0d97 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:07.334473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:07.360262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcc64d-6dea-4775-8b85-a985d6cfaf4e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:07.361178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b37f1-ee38-4de6-974b-d9c55b4f0d97 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:07.415487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:07.428677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de1e10-40e5-4e05-9050-be5cd4a7c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:07.429348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de1e10-40e5-4e05-9050-be5cd4a7c761 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:07.429636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de1e10-40e5-4e05-9050-be5cd4a7c761 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:07.429897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de1e10-40e5-4e05-9050-be5cd4a7c761 None admin] PATH_INFO: `/v3/users/ab56eabd692d401a8346ae05c4a55a01` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:07.435743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de1e10-40e5-4e05-9050-be5cd4a7c761 None admin] RBAC: Authorizing `identity:get_user(user_id=ab56eabd692d401a8346ae05c4a55a01)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:07.437228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de1e10-40e5-4e05-9050-be5cd4a7c761 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:07.439455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 80/153] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:07 2022] GET /identity/v3/users/ab56eabd692d401a8346ae05c4a55a01 => generated 289 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:07.444823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de1e10-40e5-4e05-9050-be5cd4a7c761 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:07.447846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa61bd-de7f-4378-bda3-89d116c6e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:07.448480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa61bd-de7f-4378-bda3-89d116c6e783 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:07.448764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa61bd-de7f-4378-bda3-89d116c6e783 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:07.449040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa61bd-de7f-4378-bda3-89d116c6e783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:07.449844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa61bd-de7f-4378-bda3-89d116c6e783 None admin] RBAC: Adding query filter params (role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34, user.id=ec83bbe15a0149e7887bb8e59789155b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:07.450154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa61bd-de7f-4378-bda3-89d116c6e783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:07.451627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa61bd-de7f-4378-bda3-89d116c6e783 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:07.469810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 74/154] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:07 2022] GET /identity/v3/role_assignments?user.id=ec83bbe15a0149e7887bb8e59789155b&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:07.529762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaac31-396d-4fd5-9b22-ccfaf3503456 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:07.530073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaac31-396d-4fd5-9b22-ccfaf3503456 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:07.530320 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaac31-396d-4fd5-9b22-ccfaf3503456 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:07.532238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 75/155] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:07.541638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f68cc-5e0d-4e61-98bf-1d288afb3d9b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:07.541965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f68cc-5e0d-4e61-98bf-1d288afb3d9b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:07.542205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f68cc-5e0d-4e61-98bf-1d288afb3d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:07.572574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f87f68cc-5e0d-4e61-98bf-1d288afb3d9b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:07.573809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f87f68cc-5e0d-4e61-98bf-1d288afb3d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:07.592421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de1e10-40e5-4e05-9050-be5cd4a7c761 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:07.648350 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1c26a-01f2-4110-8bff-425894905de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:07.649039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1c26a-01f2-4110-8bff-425894905de5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:07.649321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1c26a-01f2-4110-8bff-425894905de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:07.649591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1c26a-01f2-4110-8bff-425894905de5 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:07.655873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1c26a-01f2-4110-8bff-425894905de5 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:07.657396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1c26a-01f2-4110-8bff-425894905de5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:07.659255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 81/156] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:07 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:07.665517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1c26a-01f2-4110-8bff-425894905de5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:07.704119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:07.778951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 76/157] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:07.822921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1c26a-01f2-4110-8bff-425894905de5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:07.826323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f68cc-5e0d-4e61-98bf-1d288afb3d9b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:07.873899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14479b-6338-497b-9b79-3c7c5d19bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:07.879827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14479b-6338-497b-9b79-3c7c5d19bce6 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:07.880109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14479b-6338-497b-9b79-3c7c5d19bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:07.880386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14479b-6338-497b-9b79-3c7c5d19bce6 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/users/ab56eabd692d401a8346ae05c4a55a01/roles/29d5cce45377405291fc52f29711ed58` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:07.882549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14479b-6338-497b-9b79-3c7c5d19bce6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e63992ad2ad44ebd85dc7df2b2522b34, user_id=ab56eabd692d401a8346ae05c4a55a01, role_id=29d5cce45377405291fc52f29711ed58)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:07.884036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14479b-6338-497b-9b79-3c7c5d19bce6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:07.901138 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 82/158] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:27:07 2022] PUT /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/users/ab56eabd692d401a8346ae05c4a55a01/roles/29d5cce45377405291fc52f29711ed58 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:08.010331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f68cc-5e0d-4e61-98bf-1d288afb3d9b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:08.031492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:08.062135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d950d-4431-47df-a639-d5131b620c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:08.062794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d950d-4431-47df-a639-d5131b620c8e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:08.063623 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d950d-4431-47df-a639-d5131b620c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:08.063892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d950d-4431-47df-a639-d5131b620c8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:08.085897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d950d-4431-47df-a639-d5131b620c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-868d950d-4431-47df-a639-d5131b620c8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:08.090918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:08.091836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:08.092616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 77/159] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:08.099537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14479b-6338-497b-9b79-3c7c5d19bce6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:08.200759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:08.225884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14479b-6338-497b-9b79-3c7c5d19bce6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:08.272609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf16a3-0cd4-4bde-bafe-8e4d5800fbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:08.273246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf16a3-0cd4-4bde-bafe-8e4d5800fbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:08.273526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf16a3-0cd4-4bde-bafe-8e4d5800fbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:08.273798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf16a3-0cd4-4bde-bafe-8e4d5800fbb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:08.274519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf16a3-0cd4-4bde-bafe-8e4d5800fbb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:08.274817 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf16a3-0cd4-4bde-bafe-8e4d5800fbb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:08.276221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf16a3-0cd4-4bde-bafe-8e4d5800fbb4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:08.286406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 83/160] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:08.292375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d950d-4431-47df-a639-d5131b620c8e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:08.417815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d950d-4431-47df-a639-d5131b620c8e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:08.462479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c8090-cf3e-46c3-b0f0-eb9fece5ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:08.463084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8090-cf3e-46c3-b0f0-eb9fece5ef8f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:08.463366 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8090-cf3e-46c3-b0f0-eb9fece5ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:08.463639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8090-cf3e-46c3-b0f0-eb9fece5ef8f None admin] PATH_INFO: `/v3/users/ec83bbe15a0149e7887bb8e59789155b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:08.464865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c8090-cf3e-46c3-b0f0-eb9fece5ef8f None admin] RBAC: Authorizing `identity:get_user(user_id=ec83bbe15a0149e7887bb8e59789155b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:08.466342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c8090-cf3e-46c3-b0f0-eb9fece5ef8f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:08.468294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 78/161] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:08 2022] GET /identity/v3/users/ec83bbe15a0149e7887bb8e59789155b => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:08.474093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf16a3-0cd4-4bde-bafe-8e4d5800fbb4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:08.488900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d045-ac8f-4dcc-ba77-75a293f3d0e4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:08.489196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d045-ac8f-4dcc-ba77-75a293f3d0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:08.489444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d045-ac8f-4dcc-ba77-75a293f3d0e4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:08.490954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 79/162] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:08.496339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a22060-0445-4ad1-8cdd-18ad747b2729 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:08.496634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a22060-0445-4ad1-8cdd-18ad747b2729 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:08.496884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a22060-0445-4ad1-8cdd-18ad747b2729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:08.534713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-45a22060-0445-4ad1-8cdd-18ad747b2729 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:08.535951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-45a22060-0445-4ad1-8cdd-18ad747b2729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:08.653271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:08.671619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf16a3-0cd4-4bde-bafe-8e4d5800fbb4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:08.714540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c754d-b72d-4b9f-a76e-9c16c18f02f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:08.715108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c754d-b72d-4b9f-a76e-9c16c18f02f3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:08.715390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c754d-b72d-4b9f-a76e-9c16c18f02f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:08.715662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c754d-b72d-4b9f-a76e-9c16c18f02f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:08.741129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 80/163] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:08.744102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb40d3-82f4-43e4-94ea-b4712a32ab3d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:08.744390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb40d3-82f4-43e4-94ea-b4712a32ab3d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:08.744662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb40d3-82f4-43e4-94ea-b4712a32ab3d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:08.745928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 81/164] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:08.749575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:08.756405 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8fce0-f6bb-44e5-8b0d-ccada918b6e2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:08.756689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8fce0-f6bb-44e5-8b0d-ccada918b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:08.756968 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8fce0-f6bb-44e5-8b0d-ccada918b6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:08.800188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d0b8fce0-f6bb-44e5-8b0d-ccada918b6e2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:08.801386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0b8fce0-f6bb-44e5-8b0d-ccada918b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:08.898699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c754d-b72d-4b9f-a76e-9c16c18f02f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:08.900228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c754d-b72d-4b9f-a76e-9c16c18f02f3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:08.901517 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 82/165] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:08.902196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8fce0-f6bb-44e5-8b0d-ccada918b6e2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.037701 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 84/166] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:09.038511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c754d-b72d-4b9f-a76e-9c16c18f02f3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.101055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:09.116966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8fce0-f6bb-44e5-8b0d-ccada918b6e2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:09.120954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:09.156940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c754d-b72d-4b9f-a76e-9c16c18f02f3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:09.180274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b348c-6384-4d5a-9ed0-1b9d796e56e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:09.181227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b348c-6384-4d5a-9ed0-1b9d796e56e2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.181512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b348c-6384-4d5a-9ed0-1b9d796e56e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.181780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b348c-6384-4d5a-9ed0-1b9d796e56e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.208768 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b348c-6384-4d5a-9ed0-1b9d796e56e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3e3b348c-6384-4d5a-9ed0-1b9d796e56e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:09.213803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:09.214635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:09.215669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:09.223047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 83/167] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:09.224020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b348c-6384-4d5a-9ed0-1b9d796e56e2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.228613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f07a1-3eea-460e-9cd3-cb756b671a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:09.229277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f07a1-3eea-460e-9cd3-cb756b671a60 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.229556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f07a1-3eea-460e-9cd3-cb756b671a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.229828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f07a1-3eea-460e-9cd3-cb756b671a60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.248746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f07a1-3eea-460e-9cd3-cb756b671a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-921f07a1-3eea-460e-9cd3-cb756b671a60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:09.253896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:09.254770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:09.255572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:09.263220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 85/168] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:09.264395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f07a1-3eea-460e-9cd3-cb756b671a60 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.378812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f07a1-3eea-460e-9cd3-cb756b671a60 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:09.386752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:09.417420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c506a-e0e0-4a84-8c38-7d8cb31776f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:09.418039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c506a-e0e0-4a84-8c38-7d8cb31776f5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.418322 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c506a-e0e0-4a84-8c38-7d8cb31776f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.418596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c506a-e0e0-4a84-8c38-7d8cb31776f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.419363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c506a-e0e0-4a84-8c38-7d8cb31776f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:09.420384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c506a-e0e0-4a84-8c38-7d8cb31776f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:09.421780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c506a-e0e0-4a84-8c38-7d8cb31776f5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:09.431939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 86/169] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:09.432771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c506a-e0e0-4a84-8c38-7d8cb31776f5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.512996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b348c-6384-4d5a-9ed0-1b9d796e56e2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:09.543084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c506a-e0e0-4a84-8c38-7d8cb31776f5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:09.582624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e3365-22ce-4204-ac64-35ce573260c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:09.583282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e3365-22ce-4204-ac64-35ce573260c2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.583566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e3365-22ce-4204-ac64-35ce573260c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.583836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e3365-22ce-4204-ac64-35ce573260c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.584724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e3365-22ce-4204-ac64-35ce573260c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:09.585033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e3365-22ce-4204-ac64-35ce573260c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:09.586466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e3365-22ce-4204-ac64-35ce573260c2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:09.599078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 87/170] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:09.600066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e3365-22ce-4204-ac64-35ce573260c2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.635546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:09.655725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb80d0-a70a-465e-8514-583d61f1412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:09.656389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb80d0-a70a-465e-8514-583d61f1412a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.657192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb80d0-a70a-465e-8514-583d61f1412a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.657480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb80d0-a70a-465e-8514-583d61f1412a None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.663719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb80d0-a70a-465e-8514-583d61f1412a None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:09.665181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb80d0-a70a-465e-8514-583d61f1412a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:09.666872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 84/171] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:09 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:09.667671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb80d0-a70a-465e-8514-583d61f1412a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.711416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:09.717788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e3365-22ce-4204-ac64-35ce573260c2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:09.757926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f3605-7293-478b-a053-4fb817b87deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:09.757926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3605-7293-478b-a053-4fb817b87deb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.757926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3605-7293-478b-a053-4fb817b87deb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.757926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3605-7293-478b-a053-4fb817b87deb None admin] PATH_INFO: `/v3/users/ec83bbe15a0149e7887bb8e59789155b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.758438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f3605-7293-478b-a053-4fb817b87deb None admin] RBAC: Authorizing `identity:get_user(user_id=ec83bbe15a0149e7887bb8e59789155b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:09.760071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f3605-7293-478b-a053-4fb817b87deb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:09.766738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 88/172] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:09 2022] GET /identity/v3/users/ec83bbe15a0149e7887bb8e59789155b => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:09.766738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f3605-7293-478b-a053-4fb817b87deb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.785101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb80d0-a70a-465e-8514-583d61f1412a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:09.820514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1c6f2-99a6-4ef3-a5ee-6de72bc7d6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:09.821148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1c6f2-99a6-4ef3-a5ee-6de72bc7d6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.821423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1c6f2-99a6-4ef3-a5ee-6de72bc7d6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.821699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1c6f2-99a6-4ef3-a5ee-6de72bc7d6b2 None admin] PATH_INFO: `/v3/users/bf61353eb0614c70aa286ba9e0760696` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.822881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1c6f2-99a6-4ef3-a5ee-6de72bc7d6b2 None admin] RBAC: Authorizing `identity:get_user(user_id=bf61353eb0614c70aa286ba9e0760696)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:09.824374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1c6f2-99a6-4ef3-a5ee-6de72bc7d6b2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:09.826463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 85/173] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:09 2022] GET /identity/v3/users/bf61353eb0614c70aa286ba9e0760696 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:09.831904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91ee99-e6d2-4160-a17d-c52737003441 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.832452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91ee99-e6d2-4160-a17d-c52737003441 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.832941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91ee99-e6d2-4160-a17d-c52737003441 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.834685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 86/174] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:09.836002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b9b3b-53c1-4fc2-9587-55ecb26f7942 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.836426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b9b3b-53c1-4fc2-9587-55ecb26f7942 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.836842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b9b3b-53c1-4fc2-9587-55ecb26f7942 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.847035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 87/175] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:09.847035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b9b3b-53c1-4fc2-9587-55ecb26f7942 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.872616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:09.878755 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f3605-7293-478b-a053-4fb817b87deb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:09.917104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10871f1c-9028-4db7-a2e9-cf272214a361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:09.917673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10871f1c-9028-4db7-a2e9-cf272214a361 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:09.918015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10871f1c-9028-4db7-a2e9-cf272214a361 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:09.918287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10871f1c-9028-4db7-a2e9-cf272214a361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:09.919145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10871f1c-9028-4db7-a2e9-cf272214a361 None admin] RBAC: Adding query filter params (role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34, user.id=ec83bbe15a0149e7887bb8e59789155b) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:09.919451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10871f1c-9028-4db7-a2e9-cf272214a361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:09.921198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10871f1c-9028-4db7-a2e9-cf272214a361 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:09.929533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 89/176] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:09 2022] GET /identity/v3/role_assignments?user.id=ec83bbe15a0149e7887bb8e59789155b&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:09.931677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10871f1c-9028-4db7-a2e9-cf272214a361 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:09.974744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b9b3b-53c1-4fc2-9587-55ecb26f7942 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:09.979222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:10.018198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f85ef-78f2-456c-85e2-08fb15a173d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:10.019089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f85ef-78f2-456c-85e2-08fb15a173d4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.019470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f85ef-78f2-456c-85e2-08fb15a173d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.019845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f85ef-78f2-456c-85e2-08fb15a173d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.102523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f85ef-78f2-456c-85e2-08fb15a173d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:10.104131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f85ef-78f2-456c-85e2-08fb15a173d4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:10.199537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10871f1c-9028-4db7-a2e9-cf272214a361 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:10.226320 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 88/177] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:10.227797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7cdc5-4010-4a34-9a75-1c5af4ade04c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.228156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7cdc5-4010-4a34-9a75-1c5af4ade04c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.228501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7cdc5-4010-4a34-9a75-1c5af4ade04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.242873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bc268-a788-4aea-bf29-9bb03d3b2e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:10.243526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bc268-a788-4aea-bf29-9bb03d3b2e24 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.243806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bc268-a788-4aea-bf29-9bb03d3b2e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.244078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bc268-a788-4aea-bf29-9bb03d3b2e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.244430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:10.249996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-21d7cdc5-4010-4a34-9a75-1c5af4ade04c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:10.251489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21d7cdc5-4010-4a34-9a75-1c5af4ade04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:10.278316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:10.321365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bc268-a788-4aea-bf29-9bb03d3b2e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:10.322938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bc268-a788-4aea-bf29-9bb03d3b2e24 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:10.328642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 89/178] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:10.330002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b7d0-5596-42d8-a5e9-91b8294879e4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.330294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b7d0-5596-42d8-a5e9-91b8294879e4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.330568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b7d0-5596-42d8-a5e9-91b8294879e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.350702 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8739b7d0-5596-42d8-a5e9-91b8294879e4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:10.352100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8739b7d0-5596-42d8-a5e9-91b8294879e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:10.430202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 90/179] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:10.431277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b7d0-5596-42d8-a5e9-91b8294879e4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:10.463372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 90/180] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:10.465740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bc268-a788-4aea-bf29-9bb03d3b2e24 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:10.506486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:10.540096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:10.552802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b7d0-5596-42d8-a5e9-91b8294879e4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:10.580922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bc268-a788-4aea-bf29-9bb03d3b2e24 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:10.592506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99772b76-227c-4663-a263-894482412b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:10.593144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772b76-227c-4663-a263-894482412b6e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.593426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772b76-227c-4663-a263-894482412b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.593691 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772b76-227c-4663-a263-894482412b6e None admin] PATH_INFO: `/v3/projects/7eb9059575c1432f92fa522092def269` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.594870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99772b76-227c-4663-a263-894482412b6e None admin] RBAC: Authorizing `identity:get_project(project_id=7eb9059575c1432f92fa522092def269)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:10.596327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99772b76-227c-4663-a263-894482412b6e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:10.598151 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 91/181] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:10 2022] GET /identity/v3/projects/7eb9059575c1432f92fa522092def269 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:10.598805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99772b76-227c-4663-a263-894482412b6e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:10.622029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ed375-1d2d-4974-bb2e-d7ee4c297d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:10.622667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ed375-1d2d-4974-bb2e-d7ee4c297d10 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.622942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ed375-1d2d-4974-bb2e-d7ee4c297d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.623265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ed375-1d2d-4974-bb2e-d7ee4c297d10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.633724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ed375-1d2d-4974-bb2e-d7ee4c297d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-516ed375-1d2d-4974-bb2e-d7ee4c297d10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:10.638635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:10.639644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:10.640521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 91/182] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:10.641944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4447a6-581d-4818-888d-99f1127c921e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.641944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4447a6-581d-4818-888d-99f1127c921e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.642198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4447a6-581d-4818-888d-99f1127c921e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.643482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 92/183] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:10.644166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4447a6-581d-4818-888d-99f1127c921e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:10.715112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99772b76-227c-4663-a263-894482412b6e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:10.751454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:10.761436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08336672-79d9-4ef9-8b2e-fcfa88f57aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:10.762086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08336672-79d9-4ef9-8b2e-fcfa88f57aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.762459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08336672-79d9-4ef9-8b2e-fcfa88f57aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.762623 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08336672-79d9-4ef9-8b2e-fcfa88f57aa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.774255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08336672-79d9-4ef9-8b2e-fcfa88f57aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:10.776491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4447a6-581d-4818-888d-99f1127c921e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-08336672-79d9-4ef9-8b2e-fcfa88f57aa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:10.779575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:10.780427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 92/184] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:10.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08336672-79d9-4ef9-8b2e-fcfa88f57aa5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:10.805812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:10.817618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c18a1-34f4-42fc-a4f2-7e57d5e8c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:10.818259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c18a1-34f4-42fc-a4f2-7e57d5e8c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.818539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c18a1-34f4-42fc-a4f2-7e57d5e8c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.818813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c18a1-34f4-42fc-a4f2-7e57d5e8c6f0 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.820021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c18a1-34f4-42fc-a4f2-7e57d5e8c6f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:10.821486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c18a1-34f4-42fc-a4f2-7e57d5e8c6f0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:10.823189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 93/185] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:10 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:10.823189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c18a1-34f4-42fc-a4f2-7e57d5e8c6f0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:10.895565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08336672-79d9-4ef9-8b2e-fcfa88f57aa5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:10.928203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c18a1-34f4-42fc-a4f2-7e57d5e8c6f0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:10.931530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb175b-40fb-4f90-923e-791ee0a99b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:10.932150 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb175b-40fb-4f90-923e-791ee0a99b3a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.932431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb175b-40fb-4f90-923e-791ee0a99b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.932707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb175b-40fb-4f90-923e-791ee0a99b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.933498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb175b-40fb-4f90-923e-791ee0a99b3a None admin] RBAC: Adding query filter params (role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=7eb9059575c1432f92fa522092def269, user.id=ec83bbe15a0149e7887bb8e59789155b) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:10.933807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb175b-40fb-4f90-923e-791ee0a99b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:10.935321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb175b-40fb-4f90-923e-791ee0a99b3a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:10.942494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 93/186] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:10 2022] GET /identity/v3/role_assignments?user.id=ec83bbe15a0149e7887bb8e59789155b&scope.project.id=7eb9059575c1432f92fa522092def269&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:10.943763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdedd6-dd60-43dc-bf1b-e155a970f242 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.944047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdedd6-dd60-43dc-bf1b-e155a970f242 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.944313 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdedd6-dd60-43dc-bf1b-e155a970f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.963212 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-adfdedd6-dd60-43dc-bf1b-e155a970f242 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:10.964533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-adfdedd6-dd60-43dc-bf1b-e155a970f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:10.965668 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16330f50-1fe6-4be4-ae55-4c72e7ad52e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:10.966249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16330f50-1fe6-4be4-ae55-4c72e7ad52e4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:10.966574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16330f50-1fe6-4be4-ae55-4c72e7ad52e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:10.966854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16330f50-1fe6-4be4-ae55-4c72e7ad52e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:10.967672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16330f50-1fe6-4be4-ae55-4c72e7ad52e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:10.967973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16330f50-1fe6-4be4-ae55-4c72e7ad52e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:10.969494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16330f50-1fe6-4be4-ae55-4c72e7ad52e4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:10.978761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 94/187] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:10.978761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16330f50-1fe6-4be4-ae55-4c72e7ad52e4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.024200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:11.041169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:11.059024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 94/188] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:11.059024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdedd6-dd60-43dc-bf1b-e155a970f242 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.116683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16330f50-1fe6-4be4-ae55-4c72e7ad52e4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:11.161261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cffae7-efe2-4b92-9702-7164bac20fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:11.161886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cffae7-efe2-4b92-9702-7164bac20fbd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.162156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cffae7-efe2-4b92-9702-7164bac20fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.162425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cffae7-efe2-4b92-9702-7164bac20fbd None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.163163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cffae7-efe2-4b92-9702-7164bac20fbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:11.163464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cffae7-efe2-4b92-9702-7164bac20fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:11.164908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cffae7-efe2-4b92-9702-7164bac20fbd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:11.177195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 95/189] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:11.178439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b5740-2f1d-4302-bbf5-eebde0e8d20b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.178723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b5740-2f1d-4302-bbf5-eebde0e8d20b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.179051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b5740-2f1d-4302-bbf5-eebde0e8d20b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.180372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 96/190] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:11.180895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b5740-2f1d-4302-bbf5-eebde0e8d20b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.183407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdedd6-dd60-43dc-bf1b-e155a970f242 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:11.218288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce665430-7352-4efc-a3a2-406895b07c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:11.218818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce665430-7352-4efc-a3a2-406895b07c72 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.219126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce665430-7352-4efc-a3a2-406895b07c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.219911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce665430-7352-4efc-a3a2-406895b07c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.220709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce665430-7352-4efc-a3a2-406895b07c72 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34, user.id=bf61353eb0614c70aa286ba9e0760696) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:11.221008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce665430-7352-4efc-a3a2-406895b07c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:11.222438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce665430-7352-4efc-a3a2-406895b07c72 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:11.228426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 95/191] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:11 2022] GET /identity/v3/role_assignments?user.id=bf61353eb0614c70aa286ba9e0760696&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=c1429555635349208e8b2bd908436746 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:11.229213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce665430-7352-4efc-a3a2-406895b07c72 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.288553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:11.301451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b5740-2f1d-4302-bbf5-eebde0e8d20b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:11.321869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:11.347485 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300bdc0-2762-444d-92ab-bb71d3a07b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:11.348211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300bdc0-2762-444d-92ab-bb71d3a07b1e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.348505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300bdc0-2762-444d-92ab-bb71d3a07b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.348765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300bdc0-2762-444d-92ab-bb71d3a07b1e None admin] PATH_INFO: `/v3/users/1a559f0709484c8593ca98cb5c41416c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.351130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce665430-7352-4efc-a3a2-406895b07c72 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:11.365449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300bdc0-2762-444d-92ab-bb71d3a07b1e None admin] RBAC: Authorizing `identity:get_user(user_id=1a559f0709484c8593ca98cb5c41416c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:11.367189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300bdc0-2762-444d-92ab-bb71d3a07b1e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:11.374216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 97/192] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:11 2022] GET /identity/v3/users/1a559f0709484c8593ca98cb5c41416c => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:11.374216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c224d-a583-48ea-8ea3-1ba9b36d288d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.374216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c224d-a583-48ea-8ea3-1ba9b36d288d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.374216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c224d-a583-48ea-8ea3-1ba9b36d288d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.391849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8c8c224d-a583-48ea-8ea3-1ba9b36d288d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:11.393159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c8c224d-a583-48ea-8ea3-1ba9b36d288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:11.409132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877830-fa01-4e13-b5e8-517a76702909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:11.410036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877830-fa01-4e13-b5e8-517a76702909 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.410468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877830-fa01-4e13-b5e8-517a76702909 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.410747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877830-fa01-4e13-b5e8-517a76702909 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.411957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3877830-fa01-4e13-b5e8-517a76702909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:11.413424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3877830-fa01-4e13-b5e8-517a76702909 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:11.415051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 96/193] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:11.415815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877830-fa01-4e13-b5e8-517a76702909 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.473917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 98/194] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:11.474707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c224d-a583-48ea-8ea3-1ba9b36d288d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.528128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877830-fa01-4e13-b5e8-517a76702909 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:11.541096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:11.562336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9648a-1bdc-4fec-b73f-a007bf035eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:11.563019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9648a-1bdc-4fec-b73f-a007bf035eba None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.563312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9648a-1bdc-4fec-b73f-a007bf035eba None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.563587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9648a-1bdc-4fec-b73f-a007bf035eba None admin] PATH_INFO: `/v3/users/1a559f0709484c8593ca98cb5c41416c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.564826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9648a-1bdc-4fec-b73f-a007bf035eba None admin] RBAC: Authorizing `identity:get_user(user_id=1a559f0709484c8593ca98cb5c41416c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:11.566259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9648a-1bdc-4fec-b73f-a007bf035eba None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:11.567896 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 97/195] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:11 2022] GET /identity/v3/users/1a559f0709484c8593ca98cb5c41416c => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:11.568649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9648a-1bdc-4fec-b73f-a007bf035eba None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.584843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c224d-a583-48ea-8ea3-1ba9b36d288d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:11.586479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:11.620317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc98cf-8bf2-42eb-99f9-f0ee6ac6074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:11.620931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc98cf-8bf2-42eb-99f9-f0ee6ac6074c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.621207 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc98cf-8bf2-42eb-99f9-f0ee6ac6074c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.621479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc98cf-8bf2-42eb-99f9-f0ee6ac6074c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.669272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9648a-1bdc-4fec-b73f-a007bf035eba None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:11.690582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc98cf-8bf2-42eb-99f9-f0ee6ac6074c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:11.692152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc98cf-8bf2-42eb-99f9-f0ee6ac6074c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:11.702866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6498218-a2b2-4fa4-a495-170b551fe28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:11.703508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6498218-a2b2-4fa4-a495-170b551fe28a None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.703815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6498218-a2b2-4fa4-a495-170b551fe28a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.704086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6498218-a2b2-4fa4-a495-170b551fe28a None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.704836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6498218-a2b2-4fa4-a495-170b551fe28a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:11.706186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6498218-a2b2-4fa4-a495-170b551fe28a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:11.733667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 98/196] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:11 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:11.734348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6498218-a2b2-4fa4-a495-170b551fe28a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.782487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:11.805914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 99/197] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:11.810828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc98cf-8bf2-42eb-99f9-f0ee6ac6074c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.810828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:11.869944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6498218-a2b2-4fa4-a495-170b551fe28a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:11.911869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a460b87-08da-4bbf-9221-3de892a9df2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:11.912547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a460b87-08da-4bbf-9221-3de892a9df2e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.912839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a460b87-08da-4bbf-9221-3de892a9df2e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.913113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a460b87-08da-4bbf-9221-3de892a9df2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:11.925819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a460b87-08da-4bbf-9221-3de892a9df2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:11.928171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc98cf-8bf2-42eb-99f9-f0ee6ac6074c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5a460b87-08da-4bbf-9221-3de892a9df2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:11.930859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:11.931770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:11.932545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 99/198] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:11.933163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a460b87-08da-4bbf-9221-3de892a9df2e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:11.970126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabd7ff-5c3b-43f4-adc8-5e7f4efd205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:11.970758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabd7ff-5c3b-43f4-adc8-5e7f4efd205a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:11.971063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabd7ff-5c3b-43f4-adc8-5e7f4efd205a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:11.971694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabd7ff-5c3b-43f4-adc8-5e7f4efd205a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:12.059780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabd7ff-5c3b-43f4-adc8-5e7f4efd205a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:12.061179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabd7ff-5c3b-43f4-adc8-5e7f4efd205a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:12.062777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:12.063654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:12.073210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a460b87-08da-4bbf-9221-3de892a9df2e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:12.114790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b8eb-c37b-42f8-98e0-f9d2bca3aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:12.115776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b8eb-c37b-42f8-98e0-f9d2bca3aa45 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:12.116228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b8eb-c37b-42f8-98e0-f9d2bca3aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:12.116646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b8eb-c37b-42f8-98e0-f9d2bca3aa45 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:12.117993 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654b8eb-c37b-42f8-98e0-f9d2bca3aa45 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:12.119707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654b8eb-c37b-42f8-98e0-f9d2bca3aa45 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:12.121636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 100/199] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:11 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:12.122751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b8eb-c37b-42f8-98e0-f9d2bca3aa45 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:12.193147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 100/200] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:12.194399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabd7ff-5c3b-43f4-adc8-5e7f4efd205a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:12.256954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b8eb-c37b-42f8-98e0-f9d2bca3aa45 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:12.295647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9363e-c08b-4ea6-94a2-8524e33389ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:12.296696 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9363e-c08b-4ea6-94a2-8524e33389ac None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:12.297881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9363e-c08b-4ea6-94a2-8524e33389ac None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:12.298353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9363e-c08b-4ea6-94a2-8524e33389ac None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:12.299441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9363e-c08b-4ea6-94a2-8524e33389ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:12.299943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9363e-c08b-4ea6-94a2-8524e33389ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:12.301637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9363e-c08b-4ea6-94a2-8524e33389ac None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:12.311136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 101/201] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:12.312423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9363e-c08b-4ea6-94a2-8524e33389ac None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:12.315832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabd7ff-5c3b-43f4-adc8-5e7f4efd205a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:12.318557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:12.346196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:12.372614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64efbe-9c5e-4328-98c6-c217cc78ad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:12.373237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64efbe-9c5e-4328-98c6-c217cc78ad81 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:12.373516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64efbe-9c5e-4328-98c6-c217cc78ad81 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:12.373790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64efbe-9c5e-4328-98c6-c217cc78ad81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:12.374581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64efbe-9c5e-4328-98c6-c217cc78ad81 None admin] RBAC: Adding query filter params (role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=70bd38425cfc4d7aba3d67244f967485, user.id=1a559f0709484c8593ca98cb5c41416c) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:12.374890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64efbe-9c5e-4328-98c6-c217cc78ad81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:12.376441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64efbe-9c5e-4328-98c6-c217cc78ad81 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:12.382417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 101/202] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:12 2022] GET /identity/v3/role_assignments?user.id=1a559f0709484c8593ca98cb5c41416c&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:12.383464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64efbe-9c5e-4328-98c6-c217cc78ad81 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:12.452850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9363e-c08b-4ea6-94a2-8524e33389ac None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:12.491501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e4919-bde7-4b67-a9e6-ea34d0055686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:12.492504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4919-bde7-4b67-a9e6-ea34d0055686 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:12.492504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4919-bde7-4b67-a9e6-ea34d0055686 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:12.492671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e4919-bde7-4b67-a9e6-ea34d0055686 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:12.493850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4919-bde7-4b67-a9e6-ea34d0055686 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:12.495444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e4919-bde7-4b67-a9e6-ea34d0055686 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:12.497083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 102/203] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:12 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:12.504204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e4919-bde7-4b67-a9e6-ea34d0055686 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:12.550913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64efbe-9c5e-4328-98c6-c217cc78ad81 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:12.622851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b2c2f-4d06-49bd-9744-3e77c961aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:12.624289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2c2f-4d06-49bd-9744-3e77c961aa7f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:12.624765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2c2f-4d06-49bd-9744-3e77c961aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:12.625226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b2c2f-4d06-49bd-9744-3e77c961aa7f None admin] PATH_INFO: `/v3/users/ab56eabd692d401a8346ae05c4a55a01` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:12.627293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b2c2f-4d06-49bd-9744-3e77c961aa7f None admin] RBAC: Authorizing `identity:get_user(user_id=ab56eabd692d401a8346ae05c4a55a01)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:12.629416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b2c2f-4d06-49bd-9744-3e77c961aa7f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:12.631641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 102/204] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:12 2022] GET /identity/v3/users/ab56eabd692d401a8346ae05c4a55a01 => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:12.637943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b2c2f-4d06-49bd-9744-3e77c961aa7f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:12.681766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:12.689546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:12.700885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e4919-bde7-4b67-a9e6-ea34d0055686 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:12.772505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b2c2f-4d06-49bd-9744-3e77c961aa7f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:12.796504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1e2e-1d37-40d0-8ed4-49a232587cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:12.797133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1e2e-1d37-40d0-8ed4-49a232587cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:12.797443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1e2e-1d37-40d0-8ed4-49a232587cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:12.797716 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1e2e-1d37-40d0-8ed4-49a232587cd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:12.798521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1e2e-1d37-40d0-8ed4-49a232587cd8 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=70bd38425cfc4d7aba3d67244f967485, user.id=1a559f0709484c8593ca98cb5c41416c) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:12.798831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1e2e-1d37-40d0-8ed4-49a232587cd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:12.800311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1e2e-1d37-40d0-8ed4-49a232587cd8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:12.811921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 103/205] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:12 2022] GET /identity/v3/role_assignments?user.id=1a559f0709484c8593ca98cb5c41416c&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=c1429555635349208e8b2bd908436746 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:12.813766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6a195-5043-4172-9e30-985448db18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:12.814397 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6a195-5043-4172-9e30-985448db18d1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:12.814719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6a195-5043-4172-9e30-985448db18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:12.815011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6a195-5043-4172-9e30-985448db18d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:12.900425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6a195-5043-4172-9e30-985448db18d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:12.901914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6a195-5043-4172-9e30-985448db18d1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:12.952571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:13.050170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 103/206] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:13.055452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1e2e-1d37-40d0-8ed4-49a232587cd8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:13.168251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1e2e-1d37-40d0-8ed4-49a232587cd8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:13.212514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f3a0d-74a7-44fc-905f-5bb290ea2479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:13.213163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3a0d-74a7-44fc-905f-5bb290ea2479 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:13.213446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3a0d-74a7-44fc-905f-5bb290ea2479 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:13.213725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3a0d-74a7-44fc-905f-5bb290ea2479 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:13.214907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f3a0d-74a7-44fc-905f-5bb290ea2479 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:13.216376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f3a0d-74a7-44fc-905f-5bb290ea2479 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:13.218049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 104/207] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:13 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:13.223954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6a195-5043-4172-9e30-985448db18d1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:13.343308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6a195-5043-4172-9e30-985448db18d1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:13.381428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5d0fb-6e88-4d99-89c7-da80183ed7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:13.382055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d0fb-6e88-4d99-89c7-da80183ed7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:13.382337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d0fb-6e88-4d99-89c7-da80183ed7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:13.382612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5d0fb-6e88-4d99-89c7-da80183ed7b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:13.383440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5d0fb-6e88-4d99-89c7-da80183ed7b7 None admin] RBAC: Adding query filter params (role.id=29d5cce45377405291fc52f29711ed58, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34, user.id=ab56eabd692d401a8346ae05c4a55a01) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:13.383747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5d0fb-6e88-4d99-89c7-da80183ed7b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:13.385261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5d0fb-6e88-4d99-89c7-da80183ed7b7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:13.387077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:13.394017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 104/208] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:13 2022] GET /identity/v3/role_assignments?user.id=ab56eabd692d401a8346ae05c4a55a01&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=29d5cce45377405291fc52f29711ed58 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:14.068679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842853d-9b54-4610-90c3-a47fb3e19e52 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.069169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842853d-9b54-4610-90c3-a47fb3e19e52 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.069169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842853d-9b54-4610-90c3-a47fb3e19e52 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.070505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 105/209] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:14.075910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92f96-637f-4da9-908d-912b6829e42e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.076301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92f96-637f-4da9-908d-912b6829e42e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.076463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92f96-637f-4da9-908d-912b6829e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.096484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e6b92f96-637f-4da9-908d-912b6829e42e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:14.097672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e6b92f96-637f-4da9-908d-912b6829e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:14.185331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 105/210] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:14.209706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842853d-9b54-4610-90c3-a47fb3e19e52 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:14.241779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:14.302343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5c7cd-a301-427e-bdbf-d2d1355bb9f5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.302664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5c7cd-a301-427e-bdbf-d2d1355bb9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.302896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5c7cd-a301-427e-bdbf-d2d1355bb9f5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.304459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 106/211] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:14.314240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425042a1-a79a-4933-be1b-4aacbf3a2b80 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.314240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425042a1-a79a-4933-be1b-4aacbf3a2b80 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.314240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425042a1-a79a-4933-be1b-4aacbf3a2b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.328553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842853d-9b54-4610-90c3-a47fb3e19e52 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:14.333602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-425042a1-a79a-4933-be1b-4aacbf3a2b80 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:14.335019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-425042a1-a79a-4933-be1b-4aacbf3a2b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:14.368329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193ee2-02cb-40cd-aa76-0a663394b8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:14.369307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193ee2-02cb-40cd-aa76-0a663394b8ca None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.369880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193ee2-02cb-40cd-aa76-0a663394b8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.370504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b193ee2-02cb-40cd-aa76-0a663394b8ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.382430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b193ee2-02cb-40cd-aa76-0a663394b8ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7b193ee2-02cb-40cd-aa76-0a663394b8ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:14.389001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:14.389866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:14.390672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:14.394147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 106/212] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:14.399651 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193ee2-02cb-40cd-aa76-0a663394b8ca None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:14.416231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 107/213] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:14.442300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425042a1-a79a-4933-be1b-4aacbf3a2b80 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:14.493296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:14.507128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:14.511828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b193ee2-02cb-40cd-aa76-0a663394b8ca None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:14.555293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b23bde-cf30-4d2d-8cb4-0e5d6d30744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:14.556456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b23bde-cf30-4d2d-8cb4-0e5d6d30744f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.556950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b23bde-cf30-4d2d-8cb4-0e5d6d30744f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.557414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b23bde-cf30-4d2d-8cb4-0e5d6d30744f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.558390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b23bde-cf30-4d2d-8cb4-0e5d6d30744f None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:14.559063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b23bde-cf30-4d2d-8cb4-0e5d6d30744f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:14.560708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b23bde-cf30-4d2d-8cb4-0e5d6d30744f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:14.562231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425042a1-a79a-4933-be1b-4aacbf3a2b80 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:14.570358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 107/214] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:14.576158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b23bde-cf30-4d2d-8cb4-0e5d6d30744f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:14.605975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0d7ff-0678-4d5c-8c99-459f2ecd7bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:14.606544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0d7ff-0678-4d5c-8c99-459f2ecd7bac None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.606843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0d7ff-0678-4d5c-8c99-459f2ecd7bac None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.607173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0d7ff-0678-4d5c-8c99-459f2ecd7bac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.608266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0d7ff-0678-4d5c-8c99-459f2ecd7bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:14.609730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0d7ff-0678-4d5c-8c99-459f2ecd7bac None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:14.616105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 108/215] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:14.616944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0d7ff-0678-4d5c-8c99-459f2ecd7bac None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:14.692203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b23bde-cf30-4d2d-8cb4-0e5d6d30744f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:14.723474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0d7ff-0678-4d5c-8c99-459f2ecd7bac None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:14.729815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c120b61-3ea5-4daf-b597-35a9b0304388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:14.730744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c120b61-3ea5-4daf-b597-35a9b0304388 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.731362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c120b61-3ea5-4daf-b597-35a9b0304388 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.731902 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c120b61-3ea5-4daf-b597-35a9b0304388 None admin] PATH_INFO: `/v3/users/47c92982373441af94baab77c61335ee` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.749490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c120b61-3ea5-4daf-b597-35a9b0304388 None admin] RBAC: Authorizing `identity:get_user(user_id=47c92982373441af94baab77c61335ee)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:14.751792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:14.753166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c120b61-3ea5-4daf-b597-35a9b0304388 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:14.755438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 108/216] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:14 2022] GET /identity/v3/users/47c92982373441af94baab77c61335ee => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:14.767449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c120b61-3ea5-4daf-b597-35a9b0304388 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:14.767556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f89fe-335d-4845-a67e-741483bdc9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:14.767556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f89fe-335d-4845-a67e-741483bdc9e7 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.767556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f89fe-335d-4845-a67e-741483bdc9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.767556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f89fe-335d-4845-a67e-741483bdc9e7 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.767813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f89fe-335d-4845-a67e-741483bdc9e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:14.770920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f89fe-335d-4845-a67e-741483bdc9e7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:14.773607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:14.795019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 109/217] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:14 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:14.857657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867df37-2efb-4b3f-abb1-1eada6a9ac01 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.858494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867df37-2efb-4b3f-abb1-1eada6a9ac01 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.859035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867df37-2efb-4b3f-abb1-1eada6a9ac01 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.861261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 110/218] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:14.867245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6e4ba-7df6-4869-a868-bc3c3e0ee3c3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.867859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6e4ba-7df6-4869-a868-bc3c3e0ee3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.868355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6e4ba-7df6-4869-a868-bc3c3e0ee3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.892700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-93c6e4ba-7df6-4869-a868-bc3c3e0ee3c3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:14.894582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-93c6e4ba-7df6-4869-a868-bc3c3e0ee3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:14.904835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c120b61-3ea5-4daf-b597-35a9b0304388 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:14.943638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b48b7-7f18-4dd8-8b89-0b545bbd640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:14.944649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b48b7-7f18-4dd8-8b89-0b545bbd640e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:14.945123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b48b7-7f18-4dd8-8b89-0b545bbd640e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:14.945615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b48b7-7f18-4dd8-8b89-0b545bbd640e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:14.987535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 111/219] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:15.011197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6e4ba-7df6-4869-a868-bc3c3e0ee3c3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:15.026093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b48b7-7f18-4dd8-8b89-0b545bbd640e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:15.027626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b48b7-7f18-4dd8-8b89-0b545bbd640e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:15.037039 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:15.156695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6e4ba-7df6-4869-a868-bc3c3e0ee3c3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:15.159354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 109/220] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:15.164714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b48b7-7f18-4dd8-8b89-0b545bbd640e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:15.183365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:15.209908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498849e-ad2c-48cf-a92c-e452c42d9370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:15.211064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498849e-ad2c-48cf-a92c-e452c42d9370 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:15.211546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498849e-ad2c-48cf-a92c-e452c42d9370 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:15.212037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498849e-ad2c-48cf-a92c-e452c42d9370 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:15.227869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498849e-ad2c-48cf-a92c-e452c42d9370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3498849e-ad2c-48cf-a92c-e452c42d9370 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:15.235406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:15.236308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:15.237082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 112/221] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:15.239696 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd01d4b-d179-485e-8441-a2c3af245234 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:15.239900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd01d4b-d179-485e-8441-a2c3af245234 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:15.240191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd01d4b-d179-485e-8441-a2c3af245234 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:15.241603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 113/222] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:15.242179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd01d4b-d179-485e-8441-a2c3af245234 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:15.300207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b48b7-7f18-4dd8-8b89-0b545bbd640e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:15.310951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:15.347017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdd41a-5e3c-47fb-b762-e1dd819a1387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:15.347957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd41a-5e3c-47fb-b762-e1dd819a1387 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:15.348253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd41a-5e3c-47fb-b762-e1dd819a1387 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:15.348528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdd41a-5e3c-47fb-b762-e1dd819a1387 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:15.349881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdd41a-5e3c-47fb-b762-e1dd819a1387 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:15.351423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdd41a-5e3c-47fb-b762-e1dd819a1387 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:15.354236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 110/223] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:15 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:15.358948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75365df-b793-4da1-b29e-82e37f443c14 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:15.358948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75365df-b793-4da1-b29e-82e37f443c14 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:15.358948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75365df-b793-4da1-b29e-82e37f443c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:15.374533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd01d4b-d179-485e-8441-a2c3af245234 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:15.378279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f75365df-b793-4da1-b29e-82e37f443c14 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:15.378777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f75365df-b793-4da1-b29e-82e37f443c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:15.427777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224051e-55e6-41ea-831c-fe6d33c1be81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:15.428422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224051e-55e6-41ea-831c-fe6d33c1be81 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:15.428709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224051e-55e6-41ea-831c-fe6d33c1be81 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:15.429983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224051e-55e6-41ea-831c-fe6d33c1be81 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:15.430071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224051e-55e6-41ea-831c-fe6d33c1be81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:15.430575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224051e-55e6-41ea-831c-fe6d33c1be81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:15.432329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224051e-55e6-41ea-831c-fe6d33c1be81 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:15.441532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 114/224] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:15.442158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224051e-55e6-41ea-831c-fe6d33c1be81 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:15.466465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 111/225] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:15.467987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75365df-b793-4da1-b29e-82e37f443c14 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:15.480551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:15.554485 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224051e-55e6-41ea-831c-fe6d33c1be81 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:15.585063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75365df-b793-4da1-b29e-82e37f443c14 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:15.591020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de496bf-83fb-4947-a24b-c7e2aca6c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:15.591653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de496bf-83fb-4947-a24b-c7e2aca6c937 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:15.591937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de496bf-83fb-4947-a24b-c7e2aca6c937 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:15.592211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de496bf-83fb-4947-a24b-c7e2aca6c937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:15.593007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de496bf-83fb-4947-a24b-c7e2aca6c937 None admin] RBAC: Adding query filter params (role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=70bd38425cfc4d7aba3d67244f967485, user.id=47c92982373441af94baab77c61335ee) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:15.593315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de496bf-83fb-4947-a24b-c7e2aca6c937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:15.595341 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de496bf-83fb-4947-a24b-c7e2aca6c937 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:15.611014 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 115/226] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:15 2022] GET /identity/v3/role_assignments?user.id=47c92982373441af94baab77c61335ee&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:15.611014 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de496bf-83fb-4947-a24b-c7e2aca6c937 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:15.619402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:15.661888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba900187-13b6-4f30-9dfe-986fa26de3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:15.662603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900187-13b6-4f30-9dfe-986fa26de3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:15.662887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900187-13b6-4f30-9dfe-986fa26de3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:15.663187 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900187-13b6-4f30-9dfe-986fa26de3c7 None admin] PATH_INFO: `/v3/users/1a559f0709484c8593ca98cb5c41416c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:15.666747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba900187-13b6-4f30-9dfe-986fa26de3c7 None admin] RBAC: Authorizing `identity:get_user(user_id=1a559f0709484c8593ca98cb5c41416c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:15.671059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba900187-13b6-4f30-9dfe-986fa26de3c7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:15.674284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 112/227] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:15 2022] GET /identity/v3/users/1a559f0709484c8593ca98cb5c41416c => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:15.680053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba900187-13b6-4f30-9dfe-986fa26de3c7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:15.839364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:15.843860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de496bf-83fb-4947-a24b-c7e2aca6c937 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:15.896193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba900187-13b6-4f30-9dfe-986fa26de3c7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:15.919874 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996315bf-de32-4a95-afa3-cdefaf89000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:15.920849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996315bf-de32-4a95-afa3-cdefaf89000d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:15.921138 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996315bf-de32-4a95-afa3-cdefaf89000d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:15.921413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996315bf-de32-4a95-afa3-cdefaf89000d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:15.942540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996315bf-de32-4a95-afa3-cdefaf89000d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-996315bf-de32-4a95-afa3-cdefaf89000d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:15.953286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:15.955371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:15.957595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 116/228] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:27:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:15.963105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9620d17-d87b-444d-8596-a45b12d32c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:15.963105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9620d17-d87b-444d-8596-a45b12d32c89 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:15.963105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9620d17-d87b-444d-8596-a45b12d32c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:15.963105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9620d17-d87b-444d-8596-a45b12d32c89 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:15.964367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9620d17-d87b-444d-8596-a45b12d32c89 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:15.965960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9620d17-d87b-444d-8596-a45b12d32c89 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:15.967902 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996315bf-de32-4a95-afa3-cdefaf89000d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:15.968043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 113/229] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:15 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:15.977794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9620d17-d87b-444d-8596-a45b12d32c89 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:16.063405 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:16.116075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996315bf-de32-4a95-afa3-cdefaf89000d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:16.150592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccc444-e1e2-4957-9904-2ebec8a5c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:16.151250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccc444-e1e2-4957-9904-2ebec8a5c695 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:16.151591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccc444-e1e2-4957-9904-2ebec8a5c695 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:16.151879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccc444-e1e2-4957-9904-2ebec8a5c695 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:16.152636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccc444-e1e2-4957-9904-2ebec8a5c695 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:16.152950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccc444-e1e2-4957-9904-2ebec8a5c695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:16.154396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccc444-e1e2-4957-9904-2ebec8a5c695 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:16.163232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 117/230] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:16.169954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccc444-e1e2-4957-9904-2ebec8a5c695 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:16.215464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:16.221420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9620d17-d87b-444d-8596-a45b12d32c89 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:16.306279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dcffd-90d6-4df8-a7dd-fe2e23f2cd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:16.307048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dcffd-90d6-4df8-a7dd-fe2e23f2cd48 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:16.307332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dcffd-90d6-4df8-a7dd-fe2e23f2cd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:16.307657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dcffd-90d6-4df8-a7dd-fe2e23f2cd48 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485/users/1a559f0709484c8593ca98cb5c41416c/roles/22759f25d96f4063a7d10f7048d7b3bd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:16.312273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dcffd-90d6-4df8-a7dd-fe2e23f2cd48 None admin] RBAC: Authorizing `identity:create_grant(project_id=70bd38425cfc4d7aba3d67244f967485, user_id=1a559f0709484c8593ca98cb5c41416c, role_id=22759f25d96f4063a7d10f7048d7b3bd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:16.314577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dcffd-90d6-4df8-a7dd-fe2e23f2cd48 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:16.326224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccc444-e1e2-4957-9904-2ebec8a5c695 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:16.339547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 114/231] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:27:15 2022] PUT /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485/users/1a559f0709484c8593ca98cb5c41416c/roles/22759f25d96f4063a7d10f7048d7b3bd => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:16.370151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006eae-5adb-4776-99f6-9922aca982de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:16.370866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006eae-5adb-4776-99f6-9922aca982de None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:16.371181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006eae-5adb-4776-99f6-9922aca982de None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:16.371455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006eae-5adb-4776-99f6-9922aca982de None admin] PATH_INFO: `/v3/users/1a559f0709484c8593ca98cb5c41416c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:16.372699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff006eae-5adb-4776-99f6-9922aca982de None admin] RBAC: Authorizing `identity:get_user(user_id=1a559f0709484c8593ca98cb5c41416c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:16.374156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff006eae-5adb-4776-99f6-9922aca982de None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:16.376741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 118/232] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:16 2022] GET /identity/v3/users/1a559f0709484c8593ca98cb5c41416c => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:16.384141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dcffd-90d6-4df8-a7dd-fe2e23f2cd48 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:16.507935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:16.512054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dcffd-90d6-4df8-a7dd-fe2e23f2cd48 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:16.568978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c386c-284c-4394-a16f-d54cea19a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:16.569939 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c386c-284c-4394-a16f-d54cea19a672 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:16.570392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c386c-284c-4394-a16f-d54cea19a672 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:16.570801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c386c-284c-4394-a16f-d54cea19a672 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:16.572272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c386c-284c-4394-a16f-d54cea19a672 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:16.573960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c386c-284c-4394-a16f-d54cea19a672 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:16.575892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 115/233] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:16 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:16.582150 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006eae-5adb-4776-99f6-9922aca982de None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:16.685507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:16.700716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006eae-5adb-4776-99f6-9922aca982de None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:16.742004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25cc65-765c-4adc-87a7-662a02dc57fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:16.742694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25cc65-765c-4adc-87a7-662a02dc57fb None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:16.742972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25cc65-765c-4adc-87a7-662a02dc57fb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:16.743272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25cc65-765c-4adc-87a7-662a02dc57fb None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485/users/1a559f0709484c8593ca98cb5c41416c/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:16.745239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25cc65-765c-4adc-87a7-662a02dc57fb None admin] RBAC: Authorizing `identity:create_grant(project_id=70bd38425cfc4d7aba3d67244f967485, user_id=1a559f0709484c8593ca98cb5c41416c, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:16.746760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25cc65-765c-4adc-87a7-662a02dc57fb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:16.767979 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 119/234] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:27:16 2022] PUT /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485/users/1a559f0709484c8593ca98cb5c41416c/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:17.306682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b3026-ff93-4d54-8c11-ca724de28bdb None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:17.309213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b3026-ff93-4d54-8c11-ca724de28bdb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:17.309213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b3026-ff93-4d54-8c11-ca724de28bdb None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:17.309213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 116/235] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:17.315334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab27f-c031-465b-a0e3-e08ee29ca65e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:17.315778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab27f-c031-465b-a0e3-e08ee29ca65e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:17.316067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab27f-c031-465b-a0e3-e08ee29ca65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:17.320884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f2ac9-be6c-4385-8ded-a89dbe0aab88 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:17.321412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f2ac9-be6c-4385-8ded-a89dbe0aab88 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:17.321903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f2ac9-be6c-4385-8ded-a89dbe0aab88 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:17.323873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 117/236] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:17.335566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906f750-92d5-4117-ae11-3ea6fe026298 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:17.336153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906f750-92d5-4117-ae11-3ea6fe026298 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:17.336625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906f750-92d5-4117-ae11-3ea6fe026298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:17.337714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8c8ab27f-c031-465b-a0e3-e08ee29ca65e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:17.338896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c8ab27f-c031-465b-a0e3-e08ee29ca65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:17.370090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4906f750-92d5-4117-ae11-3ea6fe026298 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:17.371297 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4906f750-92d5-4117-ae11-3ea6fe026298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:17.470608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 120/237] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:17.494644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ab27f-c031-465b-a0e3-e08ee29ca65e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:17.512321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 118/238] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:17.550464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906f750-92d5-4117-ae11-3ea6fe026298 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:17.603575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:17.648215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ab27f-c031-465b-a0e3-e08ee29ca65e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:17.708675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95326d-a9ac-43e3-8c4c-1e76df03d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:17.709740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95326d-a9ac-43e3-8c4c-1e76df03d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:17.710024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95326d-a9ac-43e3-8c4c-1e76df03d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:17.710347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95326d-a9ac-43e3-8c4c-1e76df03d7a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:17.711544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95326d-a9ac-43e3-8c4c-1e76df03d7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:17.713141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95326d-a9ac-43e3-8c4c-1e76df03d7a0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:17.715040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 121/239] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:17.720543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95326d-a9ac-43e3-8c4c-1e76df03d7a0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:17.791394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:17.809140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906f750-92d5-4117-ae11-3ea6fe026298 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:17.831133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95326d-a9ac-43e3-8c4c-1e76df03d7a0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:17.873290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6a33-e10b-401e-ba16-c720b353ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:17.873834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6a33-e10b-401e-ba16-c720b353ccee None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:17.874114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6a33-e10b-401e-ba16-c720b353ccee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:17.874388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6a33-e10b-401e-ba16-c720b353ccee None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:17.875102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e6a33-e10b-401e-ba16-c720b353ccee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:17.880117 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e6a33-e10b-401e-ba16-c720b353ccee None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:17.902220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03785406-9af5-4fa8-9910-a2172c4b4ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:17.902882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03785406-9af5-4fa8-9910-a2172c4b4ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:17.903186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03785406-9af5-4fa8-9910-a2172c4b4ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:17.903462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03785406-9af5-4fa8-9910-a2172c4b4ab3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:17.917626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03785406-9af5-4fa8-9910-a2172c4b4ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:17.923177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 122/240] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:17 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:27:17.924548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420228-24ee-4a51-acf2-c1f6df4e34eb None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-03785406-9af5-4fa8-9910-a2172c4b4ab3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:17.924847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:17.925876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:17.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:17.929082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 119/241] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:17.930807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420228-24ee-4a51-acf2-c1f6df4e34eb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:17.935083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420228-24ee-4a51-acf2-c1f6df4e34eb None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:17.935083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 123/242] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:17.936975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03785406-9af5-4fa8-9910-a2172c4b4ab3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:17.947822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816ffbf-38c8-403f-beaa-a784a34cfef0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:17.948467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816ffbf-38c8-403f-beaa-a784a34cfef0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:17.949059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816ffbf-38c8-403f-beaa-a784a34cfef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:17.959374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:17.988506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6816ffbf-38c8-403f-beaa-a784a34cfef0 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:17.991391 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6816ffbf-38c8-403f-beaa-a784a34cfef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:18.128250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03785406-9af5-4fa8-9910-a2172c4b4ab3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:18.130960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 124/243] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:18.156421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816ffbf-38c8-403f-beaa-a784a34cfef0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:18.164077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aa928-c711-447f-9b52-7c9c798c8825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:18.164706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aa928-c711-447f-9b52-7c9c798c8825 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:18.164987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aa928-c711-447f-9b52-7c9c798c8825 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:18.165263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aa928-c711-447f-9b52-7c9c798c8825 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:18.165983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aa928-c711-447f-9b52-7c9c798c8825 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:18.166287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aa928-c711-447f-9b52-7c9c798c8825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:18.167692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aa928-c711-447f-9b52-7c9c798c8825 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:18.177567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 120/244] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:18.183016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aa928-c711-447f-9b52-7c9c798c8825 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:18.206880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:18.269768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816ffbf-38c8-403f-beaa-a784a34cfef0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:18.291192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aa928-c711-447f-9b52-7c9c798c8825 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:18.302108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:18.310404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b2186-f2ec-431f-a282-61a06befb834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:18.311089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2186-f2ec-431f-a282-61a06befb834 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:18.311364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2186-f2ec-431f-a282-61a06befb834 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:18.311630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2186-f2ec-431f-a282-61a06befb834 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:18.323512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b2186-f2ec-431f-a282-61a06befb834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e58b2186-f2ec-431f-a282-61a06befb834 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:18.328476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:18.329905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:18.330684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:18.331307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5dd7c-f13a-43a1-8ee0-ffba296954a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:18.331307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5dd7c-f13a-43a1-8ee0-ffba296954a8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:18.331307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5dd7c-f13a-43a1-8ee0-ffba296954a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:18.331307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5dd7c-f13a-43a1-8ee0-ffba296954a8 None admin] PATH_INFO: `/v3/users/e44c26afa5364d3fa8dc493261f3bc99` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:18.335195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 125/245] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:18.336494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b2186-f2ec-431f-a282-61a06befb834 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:18.348238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5dd7c-f13a-43a1-8ee0-ffba296954a8 None admin] RBAC: Authorizing `identity:get_user(user_id=e44c26afa5364d3fa8dc493261f3bc99)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:18.349803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5dd7c-f13a-43a1-8ee0-ffba296954a8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:18.352866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 121/246] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:18 2022] GET /identity/v3/users/e44c26afa5364d3fa8dc493261f3bc99 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:18.358336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5dd7c-f13a-43a1-8ee0-ffba296954a8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:18.456969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:18.466360 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b2186-f2ec-431f-a282-61a06befb834 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:18.478154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5dd7c-f13a-43a1-8ee0-ffba296954a8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:18.508729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286cfd0-ce9c-49ee-9449-4f001f63874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:18.509373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286cfd0-ce9c-49ee-9449-4f001f63874c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:18.509620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286cfd0-ce9c-49ee-9449-4f001f63874c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:18.509889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286cfd0-ce9c-49ee-9449-4f001f63874c None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:18.510593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286cfd0-ce9c-49ee-9449-4f001f63874c None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:18.510893 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286cfd0-ce9c-49ee-9449-4f001f63874c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:18.512300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286cfd0-ce9c-49ee-9449-4f001f63874c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:18.517669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534ebb-3f3e-4212-903e-ecb2344514f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:18.518302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534ebb-3f3e-4212-903e-ecb2344514f7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:18.519688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534ebb-3f3e-4212-903e-ecb2344514f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:18.519998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534ebb-3f3e-4212-903e-ecb2344514f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:18.521000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 126/247] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:18.526812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286cfd0-ce9c-49ee-9449-4f001f63874c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:18.590743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:18.602597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f534ebb-3f3e-4212-903e-ecb2344514f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:18.604282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f534ebb-3f3e-4212-903e-ecb2344514f7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:18.641380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286cfd0-ce9c-49ee-9449-4f001f63874c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:18.678450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2e22-9c85-4615-b818-7dc8ebb11f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:18.679143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2e22-9c85-4615-b818-7dc8ebb11f80 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:18.679420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2e22-9c85-4615-b818-7dc8ebb11f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:18.679688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2e22-9c85-4615-b818-7dc8ebb11f80 None admin] PATH_INFO: `/v3/users/47c92982373441af94baab77c61335ee` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:18.680862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d2e22-9c85-4615-b818-7dc8ebb11f80 None admin] RBAC: Authorizing `identity:get_user(user_id=47c92982373441af94baab77c61335ee)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:18.682514 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d2e22-9c85-4615-b818-7dc8ebb11f80 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:18.684317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 127/248] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:18 2022] GET /identity/v3/users/47c92982373441af94baab77c61335ee => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:18.689389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:18.690289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2e22-9c85-4615-b818-7dc8ebb11f80 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:18.712017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 122/249] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:18.717542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534ebb-3f3e-4212-903e-ecb2344514f7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:18.817944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2e22-9c85-4615-b818-7dc8ebb11f80 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:18.831595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534ebb-3f3e-4212-903e-ecb2344514f7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:18.841490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:18.854301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85bdb2-f76e-4f43-b0fb-7646911e2488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:18.854951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85bdb2-f76e-4f43-b0fb-7646911e2488 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:18.855306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85bdb2-f76e-4f43-b0fb-7646911e2488 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:18.855587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85bdb2-f76e-4f43-b0fb-7646911e2488 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:18.856776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85bdb2-f76e-4f43-b0fb-7646911e2488 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:18.858238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85bdb2-f76e-4f43-b0fb-7646911e2488 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:18.863625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 128/250] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:18 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:18.866863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85bdb2-f76e-4f43-b0fb-7646911e2488 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:18.873738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82af39-bd68-4940-a731-d67c7e9a3001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:18.874662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82af39-bd68-4940-a731-d67c7e9a3001 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:18.875216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82af39-bd68-4940-a731-d67c7e9a3001 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:18.875723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82af39-bd68-4940-a731-d67c7e9a3001 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:18.877181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82af39-bd68-4940-a731-d67c7e9a3001 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:18.878925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82af39-bd68-4940-a731-d67c7e9a3001 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:18.880957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 123/251] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:18 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:18.887515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82af39-bd68-4940-a731-d67c7e9a3001 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:18.943398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:18.974062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85bdb2-f76e-4f43-b0fb-7646911e2488 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:19.001598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82af39-bd68-4940-a731-d67c7e9a3001 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:19.020264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7e2f-f034-47df-b513-e370a44bf2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:19.020950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7e2f-f034-47df-b513-e370a44bf2b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:19.021232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7e2f-f034-47df-b513-e370a44bf2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:19.021506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7e2f-f034-47df-b513-e370a44bf2b0 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485/users/47c92982373441af94baab77c61335ee/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:19.028473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b7e2f-f034-47df-b513-e370a44bf2b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=70bd38425cfc4d7aba3d67244f967485, user_id=47c92982373441af94baab77c61335ee, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:19.029982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b7e2f-f034-47df-b513-e370a44bf2b0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:19.041817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a8046-8b6a-4167-a25f-126fabc07da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:19.042823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a8046-8b6a-4167-a25f-126fabc07da1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:19.043508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a8046-8b6a-4167-a25f-126fabc07da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:19.044010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a8046-8b6a-4167-a25f-126fabc07da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:19.045088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a8046-8b6a-4167-a25f-126fabc07da1 None admin] RBAC: Adding query filter params (role.id=29d5cce45377405291fc52f29711ed58, scope.project.id=70bd38425cfc4d7aba3d67244f967485, user.id=e44c26afa5364d3fa8dc493261f3bc99) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:19.046080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a8046-8b6a-4167-a25f-126fabc07da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:19.048660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a8046-8b6a-4167-a25f-126fabc07da1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:19.056344 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 124/252] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:18 2022] GET /identity/v3/role_assignments?user.id=e44c26afa5364d3fa8dc493261f3bc99&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=29d5cce45377405291fc52f29711ed58 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:19.057469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 129/253] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:27:18 2022] PUT /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485/users/47c92982373441af94baab77c61335ee/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:27:19.058152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f03633-15c5-45d5-bea3-7b323de24e10 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:19.063814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f03633-15c5-45d5-bea3-7b323de24e10 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:19.064418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f03633-15c5-45d5-bea3-7b323de24e10 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:19.066610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 125/254] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:19.076702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cdb78-a057-4071-9c62-4ae195532a01 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:19.077005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cdb78-a057-4071-9c62-4ae195532a01 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:19.077256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cdb78-a057-4071-9c62-4ae195532a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:19.120301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6e1cdb78-a057-4071-9c62-4ae195532a01 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:19.121563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6e1cdb78-a057-4071-9c62-4ae195532a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:19.206046 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:19.240518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 130/255] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:19.287246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f03633-15c5-45d5-bea3-7b323de24e10 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:19.419358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f03633-15c5-45d5-bea3-7b323de24e10 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:19.431857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:19.459186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556d9dc-7dc1-47ca-b65d-1d6ee3914aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:19.459906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556d9dc-7dc1-47ca-b65d-1d6ee3914aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:19.460194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556d9dc-7dc1-47ca-b65d-1d6ee3914aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:19.460467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556d9dc-7dc1-47ca-b65d-1d6ee3914aa7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:19.472355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556d9dc-7dc1-47ca-b65d-1d6ee3914aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d556d9dc-7dc1-47ca-b65d-1d6ee3914aa7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:19.477434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:19.478292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:19.479123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 126/256] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:19.488536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cdb78-a057-4071-9c62-4ae195532a01 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:19.596822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7160f1-96c1-4b7b-8390-f6d626bdfbd1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:19.597109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7160f1-96c1-4b7b-8390-f6d626bdfbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:19.597354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7160f1-96c1-4b7b-8390-f6d626bdfbd1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:19.598848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 127/257] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:19.604360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81338-c236-4e03-94a4-2116b13a98a5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:19.604646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81338-c236-4e03-94a4-2116b13a98a5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:19.604921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81338-c236-4e03-94a4-2116b13a98a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:19.628236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cdb78-a057-4071-9c62-4ae195532a01 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:19.634152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-72f81338-c236-4e03-94a4-2116b13a98a5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:19.639591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-72f81338-c236-4e03-94a4-2116b13a98a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:19.673163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bab7d1-1144-4c0c-a3d6-e0c17b7fb3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:19.673798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bab7d1-1144-4c0c-a3d6-e0c17b7fb3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:19.674079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bab7d1-1144-4c0c-a3d6-e0c17b7fb3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:19.674356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bab7d1-1144-4c0c-a3d6-e0c17b7fb3e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:19.675108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bab7d1-1144-4c0c-a3d6-e0c17b7fb3e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:19.675414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bab7d1-1144-4c0c-a3d6-e0c17b7fb3e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:19.676797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bab7d1-1144-4c0c-a3d6-e0c17b7fb3e3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:19.691642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 131/258] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:19.695954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bab7d1-1144-4c0c-a3d6-e0c17b7fb3e3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:19.717803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 128/259] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:19.756611 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:19.759200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f81338-c236-4e03-94a4-2116b13a98a5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:19.856716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bab7d1-1144-4c0c-a3d6-e0c17b7fb3e3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:19.929050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bd518-d300-4332-9008-88bb15d93214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:19.929714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bd518-d300-4332-9008-88bb15d93214 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:19.929995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bd518-d300-4332-9008-88bb15d93214 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:19.930268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bd518-d300-4332-9008-88bb15d93214 None admin] PATH_INFO: `/v3/users/1a559f0709484c8593ca98cb5c41416c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:19.934872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bd518-d300-4332-9008-88bb15d93214 None admin] RBAC: Authorizing `identity:get_user(user_id=1a559f0709484c8593ca98cb5c41416c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:19.936378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bd518-d300-4332-9008-88bb15d93214 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:19.940146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 132/260] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:19 2022] GET /identity/v3/users/1a559f0709484c8593ca98cb5c41416c => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:19.945654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bd518-d300-4332-9008-88bb15d93214 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:19.946956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f81338-c236-4e03-94a4-2116b13a98a5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:19.963343 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:20.004911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7821-5172-4024-9be6-461a8d9d345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:20.005573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7821-5172-4024-9be6-461a8d9d345f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:20.005915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7821-5172-4024-9be6-461a8d9d345f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:20.006193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7821-5172-4024-9be6-461a8d9d345f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:20.017608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf7821-5172-4024-9be6-461a8d9d345f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-87bf7821-5172-4024-9be6-461a8d9d345f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:20.022927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:20.023889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:20.024729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 129/261] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:20.032076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7821-5172-4024-9be6-461a8d9d345f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:20.159191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bd518-d300-4332-9008-88bb15d93214 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:20.180008 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:20.224272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082a717-d11b-44fb-b09a-f42896489187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:20.224910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082a717-d11b-44fb-b09a-f42896489187 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:20.225201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082a717-d11b-44fb-b09a-f42896489187 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:20.225482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082a717-d11b-44fb-b09a-f42896489187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:20.227163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7821-5172-4024-9be6-461a8d9d345f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:20.294215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3740cb-5f27-416e-bfcc-ec0efc6f20de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:20.294840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3740cb-5f27-416e-bfcc-ec0efc6f20de None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:20.295191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3740cb-5f27-416e-bfcc-ec0efc6f20de None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:20.295738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3740cb-5f27-416e-bfcc-ec0efc6f20de None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:20.296465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3740cb-5f27-416e-bfcc-ec0efc6f20de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:20.296771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3740cb-5f27-416e-bfcc-ec0efc6f20de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:20.298398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3740cb-5f27-416e-bfcc-ec0efc6f20de None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:20.317577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 130/262] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:20.322798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3740cb-5f27-416e-bfcc-ec0efc6f20de None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:20.341214 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082a717-d11b-44fb-b09a-f42896489187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:20.342944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082a717-d11b-44fb-b09a-f42896489187 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:20.378242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:20.515586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 133/263] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:20.530021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3740cb-5f27-416e-bfcc-ec0efc6f20de None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:20.541288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082a717-d11b-44fb-b09a-f42896489187 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:20.558175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:20.611612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570a66-6fbe-4a5c-93db-40d25298dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:20.612676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570a66-6fbe-4a5c-93db-40d25298dc93 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:20.613150 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570a66-6fbe-4a5c-93db-40d25298dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:20.613616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570a66-6fbe-4a5c-93db-40d25298dc93 None admin] PATH_INFO: `/v3/users/1a559f0709484c8593ca98cb5c41416c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:20.616729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c570a66-6fbe-4a5c-93db-40d25298dc93 None admin] RBAC: Authorizing `identity:get_user(user_id=1a559f0709484c8593ca98cb5c41416c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:20.618389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c570a66-6fbe-4a5c-93db-40d25298dc93 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:20.620274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 131/264] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:20 2022] GET /identity/v3/users/1a559f0709484c8593ca98cb5c41416c => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:20.627174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570a66-6fbe-4a5c-93db-40d25298dc93 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:20.732316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082a717-d11b-44fb-b09a-f42896489187 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:20.793439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:20.804564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570a66-6fbe-4a5c-93db-40d25298dc93 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:20.807667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed8fc8-7f7c-4ba0-b8ec-eff82212cd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:20.808320 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8fc8-7f7c-4ba0-b8ec-eff82212cd94 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:20.808597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8fc8-7f7c-4ba0-b8ec-eff82212cd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:20.808863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8fc8-7f7c-4ba0-b8ec-eff82212cd94 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:20.810056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed8fc8-7f7c-4ba0-b8ec-eff82212cd94 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:20.811519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed8fc8-7f7c-4ba0-b8ec-eff82212cd94 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:20.814717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 134/265] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:20 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:20.819539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed8fc8-7f7c-4ba0-b8ec-eff82212cd94 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:20.840670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2765a-0861-401a-8f9e-4ed7f32a9202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:20.841302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2765a-0861-401a-8f9e-4ed7f32a9202 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:20.841591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2765a-0861-401a-8f9e-4ed7f32a9202 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:20.841875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2765a-0861-401a-8f9e-4ed7f32a9202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:20.917566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2765a-0861-401a-8f9e-4ed7f32a9202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:20.919124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2765a-0861-401a-8f9e-4ed7f32a9202 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:20.964766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:21.001423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed8fc8-7f7c-4ba0-b8ec-eff82212cd94 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:21.059464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:21.070748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 132/266] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:21.076614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7e5b9-7429-4860-89f9-ee8e362fba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:21.077248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7e5b9-7429-4860-89f9-ee8e362fba84 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:21.077376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2765a-0861-401a-8f9e-4ed7f32a9202 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:21.077548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7e5b9-7429-4860-89f9-ee8e362fba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:21.077781 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7e5b9-7429-4860-89f9-ee8e362fba84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:21.078575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7e5b9-7429-4860-89f9-ee8e362fba84 None admin] RBAC: Adding query filter params (role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=70bd38425cfc4d7aba3d67244f967485, user.id=1a559f0709484c8593ca98cb5c41416c) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:21.078946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7e5b9-7429-4860-89f9-ee8e362fba84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:21.080431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7e5b9-7429-4860-89f9-ee8e362fba84 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:21.093605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 135/267] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:20 2022] GET /identity/v3/role_assignments?user.id=1a559f0709484c8593ca98cb5c41416c&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:21.190644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2765a-0861-401a-8f9e-4ed7f32a9202 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:21.228649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c9aa6-03f3-4a99-87d0-329d70f38be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:21.229312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c9aa6-03f3-4a99-87d0-329d70f38be9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:21.229594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c9aa6-03f3-4a99-87d0-329d70f38be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:21.229868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c9aa6-03f3-4a99-87d0-329d70f38be9 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:21.231097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c9aa6-03f3-4a99-87d0-329d70f38be9 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:21.232566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c9aa6-03f3-4a99-87d0-329d70f38be9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:21.234270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 133/268] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:21 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:21.240940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7e5b9-7429-4860-89f9-ee8e362fba84 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:21.336887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41456-2fa5-4e3a-aefe-2cf10899976b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:21.337489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41456-2fa5-4e3a-aefe-2cf10899976b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:21.337954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e41456-2fa5-4e3a-aefe-2cf10899976b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:21.339631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 134/269] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:21.345404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0898a-4381-4982-95fc-424ee5e2567c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:21.346011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0898a-4381-4982-95fc-424ee5e2567c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:21.346502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0898a-4381-4982-95fc-424ee5e2567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:21.380811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-56c0898a-4381-4982-95fc-424ee5e2567c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:21.382125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-56c0898a-4381-4982-95fc-424ee5e2567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:21.388137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7e5b9-7429-4860-89f9-ee8e362fba84 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:21.458430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bf0d8-138a-41f3-bf9e-d2f6b10cbc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:21.459095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bf0d8-138a-41f3-bf9e-d2f6b10cbc2f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:21.460373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bf0d8-138a-41f3-bf9e-d2f6b10cbc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:21.460663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bf0d8-138a-41f3-bf9e-d2f6b10cbc2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:21.461467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bf0d8-138a-41f3-bf9e-d2f6b10cbc2f None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=70bd38425cfc4d7aba3d67244f967485, user.id=1a559f0709484c8593ca98cb5c41416c) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:21.461775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bf0d8-138a-41f3-bf9e-d2f6b10cbc2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:21.463252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bf0d8-138a-41f3-bf9e-d2f6b10cbc2f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:21.479505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 136/270] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:21 2022] GET /identity/v3/role_assignments?user.id=1a559f0709484c8593ca98cb5c41416c&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=c1429555635349208e8b2bd908436746 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:21.490596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:21.508769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 135/271] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:21.537613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bf0d8-138a-41f3-bf9e-d2f6b10cbc2f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:21.548789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:21.680922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bf0d8-138a-41f3-bf9e-d2f6b10cbc2f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:21.723544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51a424-b5d3-4b1e-8215-42c6c82300d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:21.724197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51a424-b5d3-4b1e-8215-42c6c82300d8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:21.724475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51a424-b5d3-4b1e-8215-42c6c82300d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:21.724747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51a424-b5d3-4b1e-8215-42c6c82300d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:21.743997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51a424-b5d3-4b1e-8215-42c6c82300d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6b51a424-b5d3-4b1e-8215-42c6c82300d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:21.749545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:21.751231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:21.752228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:21.763093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 137/272] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:21.764985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0898a-4381-4982-95fc-424ee5e2567c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:21.831779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075defe-de7c-438a-9bf9-0db100bba46f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:21.832115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075defe-de7c-438a-9bf9-0db100bba46f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:21.832332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075defe-de7c-438a-9bf9-0db100bba46f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:21.833770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 138/273] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:21.838808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d064-ed66-4734-972d-63fa72825f13 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:21.839122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d064-ed66-4734-972d-63fa72825f13 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:21.839399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d064-ed66-4734-972d-63fa72825f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:21.867057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-98f7d064-ed66-4734-972d-63fa72825f13 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:21.868283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-98f7d064-ed66-4734-972d-63fa72825f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:21.905699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0898a-4381-4982-95fc-424ee5e2567c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:21.947684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:21.957135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 139/274] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:21.960364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6af82-87b6-41b5-9833-6661832e09c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:21.960990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6af82-87b6-41b5-9833-6661832e09c7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:21.961269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6af82-87b6-41b5-9833-6661832e09c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:21.961539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6af82-87b6-41b5-9833-6661832e09c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:21.962265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6af82-87b6-41b5-9833-6661832e09c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:21.962566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6af82-87b6-41b5-9833-6661832e09c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:21.964255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6af82-87b6-41b5-9833-6661832e09c7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:21.973902 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 136/275] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:21.979015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d064-ed66-4734-972d-63fa72825f13 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:21.990805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6af82-87b6-41b5-9833-6661832e09c7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:22.057286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:22.111917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d064-ed66-4734-972d-63fa72825f13 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:22.118687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6af82-87b6-41b5-9833-6661832e09c7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:22.156554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4de8-d080-4f36-8093-32e9d35b326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:22.156911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3dee-2ee2-4b32-8970-3a28619c4f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:22.157449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4de8-d080-4f36-8093-32e9d35b326a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.157565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3dee-2ee2-4b32-8970-3a28619c4f32 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.157842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4de8-d080-4f36-8093-32e9d35b326a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.157969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3dee-2ee2-4b32-8970-3a28619c4f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.158173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4de8-d080-4f36-8093-32e9d35b326a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.158270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3dee-2ee2-4b32-8970-3a28619c4f32 None admin] PATH_INFO: `/v3/users/7a74d1dfc98c48188c70dd033857e1d4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.159469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4de8-d080-4f36-8093-32e9d35b326a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:22.160949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4de8-d080-4f36-8093-32e9d35b326a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:22.162673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 137/276] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:22.163700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a3676-042d-47dc-b6c2-5f8b290b431b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.163984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a3676-042d-47dc-b6c2-5f8b290b431b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.164255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a3676-042d-47dc-b6c2-5f8b290b431b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.165570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 138/277] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:22.170407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9efc-55cf-4118-b20d-39edabd0ef95 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.171149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9efc-55cf-4118-b20d-39edabd0ef95 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.171246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9efc-55cf-4118-b20d-39edabd0ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.178510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f3dee-2ee2-4b32-8970-3a28619c4f32 None admin] RBAC: Authorizing `identity:get_user(user_id=7a74d1dfc98c48188c70dd033857e1d4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:22.180657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f3dee-2ee2-4b32-8970-3a28619c4f32 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:22.187089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 140/278] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:21 2022] GET /identity/v3/users/7a74d1dfc98c48188c70dd033857e1d4 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:22.187089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3dee-2ee2-4b32-8970-3a28619c4f32 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:22.194323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f5ea9efc-55cf-4118-b20d-39edabd0ef95 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:22.195536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f5ea9efc-55cf-4118-b20d-39edabd0ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:22.271246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:22.292396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 139/279] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:22.293242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9efc-55cf-4118-b20d-39edabd0ef95 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:22.323608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3dee-2ee2-4b32-8970-3a28619c4f32 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:22.341403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:22.357090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f03219-6ae8-4390-8952-7e8e926b77ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:22.357705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03219-6ae8-4390-8952-7e8e926b77ce None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.357986 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03219-6ae8-4390-8952-7e8e926b77ce None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.358263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03219-6ae8-4390-8952-7e8e926b77ce None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.358936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f03219-6ae8-4390-8952-7e8e926b77ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:22.361028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f03219-6ae8-4390-8952-7e8e926b77ce None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:22.383276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 141/280] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:22 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:22.384525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e042e-510c-4594-a56c-fc7b987ef26d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.384846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e042e-510c-4594-a56c-fc7b987ef26d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.385308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e042e-510c-4594-a56c-fc7b987ef26d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.386485 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 142/281] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:22.391928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e042e-510c-4594-a56c-fc7b987ef26d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:22.396491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9efc-55cf-4118-b20d-39edabd0ef95 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:22.436614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1beaf-527d-45cf-bc06-2e5630701176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:22.437264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1beaf-527d-45cf-bc06-2e5630701176 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.437545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1beaf-527d-45cf-bc06-2e5630701176 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.437818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1beaf-527d-45cf-bc06-2e5630701176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.439208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1beaf-527d-45cf-bc06-2e5630701176 None admin] RBAC: Adding query filter params (role.id=a8a24aac5beb466aa9599c299ab9ec1a, user.id=7a74d1dfc98c48188c70dd033857e1d4, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:22.439524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1beaf-527d-45cf-bc06-2e5630701176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:22.441028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1beaf-527d-45cf-bc06-2e5630701176 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:22.447012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 140/282] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Aug 4 04:27:22 2022] GET /identity/v3/role_assignments?user.id=7a74d1dfc98c48188c70dd033857e1d4&scope.system=all&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:22.449080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb04ecf-dd10-4cc5-ba6e-296c38e66c51 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.449594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb04ecf-dd10-4cc5-ba6e-296c38e66c51 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.450073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb04ecf-dd10-4cc5-ba6e-296c38e66c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.473473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-edb04ecf-dd10-4cc5-ba6e-296c38e66c51 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:22.475186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-edb04ecf-dd10-4cc5-ba6e-296c38e66c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:22.559306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e042e-510c-4594-a56c-fc7b987ef26d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:22.567154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 141/283] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:22.573224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:22.600224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb04ecf-dd10-4cc5-ba6e-296c38e66c51 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:22.606394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd025-a446-4061-9591-ba52211cc0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:22.607092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd025-a446-4061-9591-ba52211cc0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.607373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd025-a446-4061-9591-ba52211cc0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.607640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd025-a446-4061-9591-ba52211cc0e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.620958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd025-a446-4061-9591-ba52211cc0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6b6bd025-a446-4061-9591-ba52211cc0e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:22.627543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:22.628466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:22.629270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 143/284] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:22.634836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd025-a446-4061-9591-ba52211cc0e1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:22.659799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:22.741336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb04ecf-dd10-4cc5-ba6e-296c38e66c51 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:22.777051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd025-a446-4061-9591-ba52211cc0e1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:22.784906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c09bb4-04e3-4439-bcae-83f4f4d5d3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:22.785937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c09bb4-04e3-4439-bcae-83f4f4d5d3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.785937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c09bb4-04e3-4439-bcae-83f4f4d5d3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.786142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c09bb4-04e3-4439-bcae-83f4f4d5d3d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.801539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c09bb4-04e3-4439-bcae-83f4f4d5d3d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b0c09bb4-04e3-4439-bcae-83f4f4d5d3d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:22.806671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:22.807588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:22.808368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:22.809472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 142/285] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:22.820020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c09bb4-04e3-4439-bcae-83f4f4d5d3d7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:22.827705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeb111-21ad-41b2-b728-a85a0f2178de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:22.828334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeb111-21ad-41b2-b728-a85a0f2178de None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.828614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeb111-21ad-41b2-b728-a85a0f2178de None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.829432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeb111-21ad-41b2-b728-a85a0f2178de None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.830155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aeb111-21ad-41b2-b728-a85a0f2178de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:22.830454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aeb111-21ad-41b2-b728-a85a0f2178de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:22.831960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aeb111-21ad-41b2-b728-a85a0f2178de None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:22.842001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 144/286] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:22.847183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeb111-21ad-41b2-b728-a85a0f2178de None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:22.887631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:22.927733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c09bb4-04e3-4439-bcae-83f4f4d5d3d7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:22.929288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:22.964881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e58bc-9f3a-4e3f-9d41-4f741d5a445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:22.965501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e58bc-9f3a-4e3f-9d41-4f741d5a445f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:22.965776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e58bc-9f3a-4e3f-9d41-4f741d5a445f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:22.966045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e58bc-9f3a-4e3f-9d41-4f741d5a445f None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:22.966762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e58bc-9f3a-4e3f-9d41-4f741d5a445f None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:22.967090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e58bc-9f3a-4e3f-9d41-4f741d5a445f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:22.967821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeb111-21ad-41b2-b728-a85a0f2178de None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:22.968456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e58bc-9f3a-4e3f-9d41-4f741d5a445f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:22.978151 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 143/287] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:22.983676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e58bc-9f3a-4e3f-9d41-4f741d5a445f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:23.007979 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c522ca7-22cc-42b3-93eb-bc0eeae851da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:23.008983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c522ca7-22cc-42b3-93eb-bc0eeae851da None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:23.009596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c522ca7-22cc-42b3-93eb-bc0eeae851da None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:23.010203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c522ca7-22cc-42b3-93eb-bc0eeae851da None admin] PATH_INFO: `/v3/users/e44c26afa5364d3fa8dc493261f3bc99` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:23.011677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c522ca7-22cc-42b3-93eb-bc0eeae851da None admin] RBAC: Authorizing `identity:get_user(user_id=e44c26afa5364d3fa8dc493261f3bc99)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:23.013579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c522ca7-22cc-42b3-93eb-bc0eeae851da None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:23.015628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 145/288] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:22 2022] GET /identity/v3/users/e44c26afa5364d3fa8dc493261f3bc99 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:23.021354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c522ca7-22cc-42b3-93eb-bc0eeae851da None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:23.087188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e58bc-9f3a-4e3f-9d41-4f741d5a445f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:23.121694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64995dd5-f18e-453b-b684-508273a31daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:23.122382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64995dd5-f18e-453b-b684-508273a31daf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:23.122663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64995dd5-f18e-453b-b684-508273a31daf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:23.122933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64995dd5-f18e-453b-b684-508273a31daf None admin] PATH_INFO: `/v3/users/47c92982373441af94baab77c61335ee` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:23.124151 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64995dd5-f18e-453b-b684-508273a31daf None admin] RBAC: Authorizing `identity:get_user(user_id=47c92982373441af94baab77c61335ee)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:23.126130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64995dd5-f18e-453b-b684-508273a31daf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:23.128129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 144/289] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:22 2022] GET /identity/v3/users/47c92982373441af94baab77c61335ee => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:23.133404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64995dd5-f18e-453b-b684-508273a31daf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:23.133936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:23.139122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c522ca7-22cc-42b3-93eb-bc0eeae851da None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:23.166515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:23.187629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6a462-9873-4849-b69d-411a4b09dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:23.189323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a462-9873-4849-b69d-411a4b09dc34 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:23.191132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a462-9873-4849-b69d-411a4b09dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:23.191613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a462-9873-4849-b69d-411a4b09dc34 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:23.193284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6a462-9873-4849-b69d-411a4b09dc34 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:23.195805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6a462-9873-4849-b69d-411a4b09dc34 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:23.198467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 146/290] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:23 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:23.206043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6a462-9873-4849-b69d-411a4b09dc34 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:23.293324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64995dd5-f18e-453b-b684-508273a31daf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:23.354830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866355c-4657-4f6e-abec-4e169ab51f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:23.355826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866355c-4657-4f6e-abec-4e169ab51f80 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:23.356308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866355c-4657-4f6e-abec-4e169ab51f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:23.356777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866355c-4657-4f6e-abec-4e169ab51f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:23.408165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6a462-9873-4849-b69d-411a4b09dc34 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:23.473872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866355c-4657-4f6e-abec-4e169ab51f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:23.475365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866355c-4657-4f6e-abec-4e169ab51f80 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:23.481614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74572ac-5ea8-4432-8ab0-26bdf510cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:23.482284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74572ac-5ea8-4432-8ab0-26bdf510cd0a None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:23.482556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74572ac-5ea8-4432-8ab0-26bdf510cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:23.482826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74572ac-5ea8-4432-8ab0-26bdf510cd0a None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485/users/e44c26afa5364d3fa8dc493261f3bc99/roles/29d5cce45377405291fc52f29711ed58` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:23.488586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74572ac-5ea8-4432-8ab0-26bdf510cd0a None admin] RBAC: Authorizing `identity:create_grant(project_id=70bd38425cfc4d7aba3d67244f967485, user_id=e44c26afa5364d3fa8dc493261f3bc99, role_id=29d5cce45377405291fc52f29711ed58)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:23.490017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74572ac-5ea8-4432-8ab0-26bdf510cd0a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:23.511810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 147/291] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:27:23 2022] PUT /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485/users/e44c26afa5364d3fa8dc493261f3bc99/roles/29d5cce45377405291fc52f29711ed58 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:23.537329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:23.616827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 145/292] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:23.622545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74572ac-5ea8-4432-8ab0-26bdf510cd0a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:23.675705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:23.780048 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74572ac-5ea8-4432-8ab0-26bdf510cd0a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:23.819546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210186a-0dcc-4edc-b475-63e2ea2a4c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:23.820207 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210186a-0dcc-4edc-b475-63e2ea2a4c18 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:23.820487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210186a-0dcc-4edc-b475-63e2ea2a4c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:23.820757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210186a-0dcc-4edc-b475-63e2ea2a4c18 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:23.823808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210186a-0dcc-4edc-b475-63e2ea2a4c18 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:23.825276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210186a-0dcc-4edc-b475-63e2ea2a4c18 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:23.826974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 148/293] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:23 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:23.833216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866355c-4657-4f6e-abec-4e169ab51f80 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:23.967977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866355c-4657-4f6e-abec-4e169ab51f80 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:24.012200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:24.022829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cd6f3-10a1-4d66-8a07-70b4c1e27db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:24.023858 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cd6f3-10a1-4d66-8a07-70b4c1e27db5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:24.024170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cd6f3-10a1-4d66-8a07-70b4c1e27db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:24.024480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cd6f3-10a1-4d66-8a07-70b4c1e27db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:24.025672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cd6f3-10a1-4d66-8a07-70b4c1e27db5 None admin] RBAC: Adding query filter params (role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=70bd38425cfc4d7aba3d67244f967485, user.id=47c92982373441af94baab77c61335ee) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:24.026123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cd6f3-10a1-4d66-8a07-70b4c1e27db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:24.027934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cd6f3-10a1-4d66-8a07-70b4c1e27db5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:24.039903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 146/294] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:23 2022] GET /identity/v3/role_assignments?user.id=47c92982373441af94baab77c61335ee&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:24.827493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb77d0-57f3-47a3-98ea-001fcfe17112 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:24.828479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb77d0-57f3-47a3-98ea-001fcfe17112 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:24.828989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb77d0-57f3-47a3-98ea-001fcfe17112 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:24.830547 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 149/295] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:24.836121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76435aaf-925c-4686-be63-fcde81089f5f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:24.836574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76435aaf-925c-4686-be63-fcde81089f5f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:24.836648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76435aaf-925c-4686-be63-fcde81089f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:24.855590 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-76435aaf-925c-4686-be63-fcde81089f5f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:24.856811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-76435aaf-925c-4686-be63-fcde81089f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:24.926440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 147/296] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:24.947790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb77d0-57f3-47a3-98ea-001fcfe17112 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:25.023470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1115b-bda5-4a00-ac58-bf6cf8d9e9fe None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.024087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1115b-bda5-4a00-ac58-bf6cf8d9e9fe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.024548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1115b-bda5-4a00-ac58-bf6cf8d9e9fe None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.026084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 148/297] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:25.031359 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0e3b4-0a99-46ea-a2ff-18f4e4b9afdd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.031927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0e3b4-0a99-46ea-a2ff-18f4e4b9afdd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.032421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0e3b4-0a99-46ea-a2ff-18f4e4b9afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.061166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ddc0e3b4-0a99-46ea-a2ff-18f4e4b9afdd None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:25.062677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:25.063152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ddc0e3b4-0a99-46ea-a2ff-18f4e4b9afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:25.073229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb77d0-57f3-47a3-98ea-001fcfe17112 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:25.114888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea9d38-2959-4426-a36b-39d91a7eeb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:25.116228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea9d38-2959-4426-a36b-39d91a7eeb4a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.116687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea9d38-2959-4426-a36b-39d91a7eeb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.117099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea9d38-2959-4426-a36b-39d91a7eeb4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.130966 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea9d38-2959-4426-a36b-39d91a7eeb4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-67ea9d38-2959-4426-a36b-39d91a7eeb4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:25.138249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:25.139625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:25.140632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:25.143379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 150/298] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:25.149999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea9d38-2959-4426-a36b-39d91a7eeb4a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:25.155042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 149/299] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:25.159553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac96f2-80fd-4b22-9ad2-1ace667ac37c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.160134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac96f2-80fd-4b22-9ad2-1ace667ac37c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.160605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac96f2-80fd-4b22-9ad2-1ace667ac37c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.162319 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 150/300] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:25.167321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbce6b-f9e6-476c-86e7-f594905a9b8c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.167764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbce6b-f9e6-476c-86e7-f594905a9b8c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.168199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbce6b-f9e6-476c-86e7-f594905a9b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.187844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-69cbce6b-f9e6-476c-86e7-f594905a9b8c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:25.189767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-69cbce6b-f9e6-476c-86e7-f594905a9b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:25.253098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:25.259986 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea9d38-2959-4426-a36b-39d91a7eeb4a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:25.270749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 151/301] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:25.271847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbce6b-f9e6-476c-86e7-f594905a9b8c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:25.309845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc823f99-125a-4a75-bd0e-7645fa327631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:25.310380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc823f99-125a-4a75-bd0e-7645fa327631 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.310659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc823f99-125a-4a75-bd0e-7645fa327631 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.310929 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc823f99-125a-4a75-bd0e-7645fa327631 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.311676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc823f99-125a-4a75-bd0e-7645fa327631 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:25.311981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc823f99-125a-4a75-bd0e-7645fa327631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:25.313382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc823f99-125a-4a75-bd0e-7645fa327631 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:25.321562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 151/302] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:25.322366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc823f99-125a-4a75-bd0e-7645fa327631 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:25.341282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:25.386494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbce6b-f9e6-476c-86e7-f594905a9b8c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:25.429595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc823f99-125a-4a75-bd0e-7645fa327631 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:25.430045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2a909-f36e-437c-bd36-b991c290c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:25.430713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2a909-f36e-437c-bd36-b991c290c29b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.431012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2a909-f36e-437c-bd36-b991c290c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.431303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2a909-f36e-437c-bd36-b991c290c29b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.444059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2a909-f36e-437c-bd36-b991c290c29b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f0a2a909-f36e-437c-bd36-b991c290c29b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:25.449075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:25.449934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:25.450688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 152/303] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:25.451676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2a909-f36e-437c-bd36-b991c290c29b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:25.475232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f946-26fd-4f74-a2bf-f1592d113807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:25.475876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f946-26fd-4f74-a2bf-f1592d113807 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.476158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f946-26fd-4f74-a2bf-f1592d113807 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.476432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f946-26fd-4f74-a2bf-f1592d113807 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.477585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901f946-26fd-4f74-a2bf-f1592d113807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:25.479065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901f946-26fd-4f74-a2bf-f1592d113807 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:25.480657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 152/304] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:25.484162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f946-26fd-4f74-a2bf-f1592d113807 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:25.505502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:25.562598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2a909-f36e-437c-bd36-b991c290c29b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:25.587204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:25.601097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffec74-1c5b-4d18-a821-6b7d938030e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:25.601742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffec74-1c5b-4d18-a821-6b7d938030e2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.602028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffec74-1c5b-4d18-a821-6b7d938030e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.602279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffec74-1c5b-4d18-a821-6b7d938030e2 None admin] PATH_INFO: `/v3/users/7a74d1dfc98c48188c70dd033857e1d4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.603539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffec74-1c5b-4d18-a821-6b7d938030e2 None admin] RBAC: Authorizing `identity:get_user(user_id=7a74d1dfc98c48188c70dd033857e1d4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:25.604818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f946-26fd-4f74-a2bf-f1592d113807 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:25.605031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffec74-1c5b-4d18-a821-6b7d938030e2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:25.611332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 153/305] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:25 2022] GET /identity/v3/users/7a74d1dfc98c48188c70dd033857e1d4 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:25.611332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffec74-1c5b-4d18-a821-6b7d938030e2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:25.647499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1de54-cf61-4934-ac02-4d9eb16bdbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:25.648421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1de54-cf61-4934-ac02-4d9eb16bdbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.648700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1de54-cf61-4934-ac02-4d9eb16bdbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.648973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1de54-cf61-4934-ac02-4d9eb16bdbd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.649688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1de54-cf61-4934-ac02-4d9eb16bdbd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:25.649990 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1de54-cf61-4934-ac02-4d9eb16bdbd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:25.651396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1de54-cf61-4934-ac02-4d9eb16bdbd5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:25.660253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 153/306] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:25.665334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1de54-cf61-4934-ac02-4d9eb16bdbd5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:25.717538 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffec74-1c5b-4d18-a821-6b7d938030e2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:25.739006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:25.765133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d7337-3a52-43f2-b95c-ec6111e0c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:25.766003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d7337-3a52-43f2-b95c-ec6111e0c8ef None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.766003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d7337-3a52-43f2-b95c-ec6111e0c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.766818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d7337-3a52-43f2-b95c-ec6111e0c8ef None admin] PATH_INFO: `/v3/groups` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.767624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d7337-3a52-43f2-b95c-ec6111e0c8ef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:25.769105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d7337-3a52-43f2-b95c-ec6111e0c8ef None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:25.772830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1de54-cf61-4934-ac02-4d9eb16bdbd5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:25.791527 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 154/307] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Aug 4 04:27:25 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:25.792804 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d7337-3a52-43f2-b95c-ec6111e0c8ef None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:25.816855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c94d2-2949-4297-a113-616b5d4c886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:25.817884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c94d2-2949-4297-a113-616b5d4c886a None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.818370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c94d2-2949-4297-a113-616b5d4c886a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.818905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c94d2-2949-4297-a113-616b5d4c886a None admin] PATH_INFO: `/v3/system/users/7a74d1dfc98c48188c70dd033857e1d4/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.820789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c94d2-2949-4297-a113-616b5d4c886a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a74d1dfc98c48188c70dd033857e1d4, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:25.822515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c94d2-2949-4297-a113-616b5d4c886a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:25.835007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 154/308] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Aug 4 04:27:25 2022] PUT /identity/v3/system/users/7a74d1dfc98c48188c70dd033857e1d4/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:25.912757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257ae1b-77df-4289-adef-68913b78d364 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.912997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257ae1b-77df-4289-adef-68913b78d364 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.913270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257ae1b-77df-4289-adef-68913b78d364 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.915006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 155/309] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:25.921006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17adff-aaf0-4f50-99e9-c07d1f276cb5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.921326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17adff-aaf0-4f50-99e9-c07d1f276cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.921573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17adff-aaf0-4f50-99e9-c07d1f276cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:25.938826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d7337-3a52-43f2-b95c-ec6111e0c8ef None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:25.943297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dc17adff-aaf0-4f50-99e9-c07d1f276cb5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:25.949342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dc17adff-aaf0-4f50-99e9-c07d1f276cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:25.961185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:25.994371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd256988-1321-4872-987c-72e1d7552460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:25.995969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd256988-1321-4872-987c-72e1d7552460 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:25.995969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd256988-1321-4872-987c-72e1d7552460 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:25.996183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd256988-1321-4872-987c-72e1d7552460 None admin] PATH_INFO: `/v3/users/99931dca609a460b8aab7116cb4297a9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:26.013887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd256988-1321-4872-987c-72e1d7552460 None admin] RBAC: Authorizing `identity:get_user(user_id=99931dca609a460b8aab7116cb4297a9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:26.015403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd256988-1321-4872-987c-72e1d7552460 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:26.017163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 155/310] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:25 2022] GET /identity/v3/users/99931dca609a460b8aab7116cb4297a9 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:26.023156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd256988-1321-4872-987c-72e1d7552460 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:26.047246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 156/311] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:26.070091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17adff-aaf0-4f50-99e9-c07d1f276cb5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:26.070276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:26.144979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd256988-1321-4872-987c-72e1d7552460 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:26.183447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17adff-aaf0-4f50-99e9-c07d1f276cb5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:26.184437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ba734-b901-45d3-8a86-a3261eb10d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:26.185383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ba734-b901-45d3-8a86-a3261eb10d5d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:26.186655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ba734-b901-45d3-8a86-a3261eb10d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:26.187109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ba734-b901-45d3-8a86-a3261eb10d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:26.188084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ba734-b901-45d3-8a86-a3261eb10d5d None admin] RBAC: Adding query filter params (role.id=29d5cce45377405291fc52f29711ed58, user.id=99931dca609a460b8aab7116cb4297a9, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:26.188586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ba734-b901-45d3-8a86-a3261eb10d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:26.190214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ba734-b901-45d3-8a86-a3261eb10d5d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:26.197399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 156/312] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Aug 4 04:27:26 2022] GET /identity/v3/role_assignments?user.id=99931dca609a460b8aab7116cb4297a9&scope.system=all&role.id=29d5cce45377405291fc52f29711ed58 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:26.225743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149798d-cdfc-47aa-8b18-0fc64fa4996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:26.226408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149798d-cdfc-47aa-8b18-0fc64fa4996a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:26.226682 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149798d-cdfc-47aa-8b18-0fc64fa4996a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:26.226948 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149798d-cdfc-47aa-8b18-0fc64fa4996a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:26.240394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149798d-cdfc-47aa-8b18-0fc64fa4996a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e149798d-cdfc-47aa-8b18-0fc64fa4996a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:26.245742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:26.246863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:26.247895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 157/313] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:26.255067 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ba734-b901-45d3-8a86-a3261eb10d5d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:26.368494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:26.375527 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ba734-b901-45d3-8a86-a3261eb10d5d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:26.413748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414255d-aae3-4adc-9bf6-64dd003069fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:26.414371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414255d-aae3-4adc-9bf6-64dd003069fc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:26.414654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414255d-aae3-4adc-9bf6-64dd003069fc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:26.414925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414255d-aae3-4adc-9bf6-64dd003069fc None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:26.415672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414255d-aae3-4adc-9bf6-64dd003069fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:26.415970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414255d-aae3-4adc-9bf6-64dd003069fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:26.417343 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414255d-aae3-4adc-9bf6-64dd003069fc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:26.427156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 157/314] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:26.432400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149798d-cdfc-47aa-8b18-0fc64fa4996a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:26.436129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:26.545217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149798d-cdfc-47aa-8b18-0fc64fa4996a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:26.586461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40810b96-e592-462a-88aa-02b14388dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:26.587162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40810b96-e592-462a-88aa-02b14388dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:26.587441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40810b96-e592-462a-88aa-02b14388dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:26.587710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40810b96-e592-462a-88aa-02b14388dbc5 None admin] PATH_INFO: `/v3/users/e44c26afa5364d3fa8dc493261f3bc99` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:26.588897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40810b96-e592-462a-88aa-02b14388dbc5 None admin] RBAC: Authorizing `identity:get_user(user_id=e44c26afa5364d3fa8dc493261f3bc99)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:26.590332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40810b96-e592-462a-88aa-02b14388dbc5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:26.592198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 158/315] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:26 2022] GET /identity/v3/users/e44c26afa5364d3fa8dc493261f3bc99 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:26.598144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414255d-aae3-4adc-9bf6-64dd003069fc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:26.710903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414255d-aae3-4adc-9bf6-64dd003069fc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:26.746120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b8997-2bba-429f-8156-074e21c78861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:26.746739 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b8997-2bba-429f-8156-074e21c78861 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:26.747044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b8997-2bba-429f-8156-074e21c78861 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:26.747323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b8997-2bba-429f-8156-074e21c78861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:26.779209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:26.823776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b8997-2bba-429f-8156-074e21c78861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:26.825240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b8997-2bba-429f-8156-074e21c78861 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:26.929187 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 158/316] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:26.934866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40810b96-e592-462a-88aa-02b14388dbc5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:27.013597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:27.050229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40810b96-e592-462a-88aa-02b14388dbc5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:27.095174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178171eb-eb11-4ce7-ac35-a7d39e25d435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:27.095174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178171eb-eb11-4ce7-ac35-a7d39e25d435 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:27.095174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178171eb-eb11-4ce7-ac35-a7d39e25d435 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:27.095174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178171eb-eb11-4ce7-ac35-a7d39e25d435 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:27.095564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178171eb-eb11-4ce7-ac35-a7d39e25d435 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:27.095564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178171eb-eb11-4ce7-ac35-a7d39e25d435 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:27.095564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 159/317] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:26 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:27.099972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b8997-2bba-429f-8156-074e21c78861 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:27.177616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:27.221258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b8997-2bba-429f-8156-074e21c78861 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:27.256435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2267f0-2152-4d27-8f89-d882384d72f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:27.257045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2267f0-2152-4d27-8f89-d882384d72f4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:27.257324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2267f0-2152-4d27-8f89-d882384d72f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:27.257593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2267f0-2152-4d27-8f89-d882384d72f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:27.258436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2267f0-2152-4d27-8f89-d882384d72f4 None admin] RBAC: Adding query filter params (role.id=29d5cce45377405291fc52f29711ed58, scope.project.id=70bd38425cfc4d7aba3d67244f967485, user.id=e44c26afa5364d3fa8dc493261f3bc99) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:27.258742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2267f0-2152-4d27-8f89-d882384d72f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:27.260191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2267f0-2152-4d27-8f89-d882384d72f4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:27.266518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 159/318] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:27 2022] GET /identity/v3/role_assignments?user.id=e44c26afa5364d3fa8dc493261f3bc99&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=29d5cce45377405291fc52f29711ed58 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:27.944743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02f2e8-799e-40e3-a417-980988c25a67 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:27.945287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02f2e8-799e-40e3-a417-980988c25a67 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:27.945287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02f2e8-799e-40e3-a417-980988c25a67 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:27.946768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 160/319] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:27.951737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213d8d6-8822-43c0-8566-9a1ae39387d0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:27.952022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213d8d6-8822-43c0-8566-9a1ae39387d0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:27.952295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213d8d6-8822-43c0-8566-9a1ae39387d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:27.970820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6213d8d6-8822-43c0-8566-9a1ae39387d0 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:27.972028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6213d8d6-8822-43c0-8566-9a1ae39387d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:28.000359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00109b-1922-483f-99d4-9b64d1324d59 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.000773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00109b-1922-483f-99d4-9b64d1324d59 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.000969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00109b-1922-483f-99d4-9b64d1324d59 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.002439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 161/320] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:28.007140 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d839-e3ac-4e14-97bc-ca1c2780e3ac None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.007427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d839-e3ac-4e14-97bc-ca1c2780e3ac None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.007799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d839-e3ac-4e14-97bc-ca1c2780e3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.025943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7974d839-e3ac-4e14-97bc-ca1c2780e3ac None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:28.027157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7974d839-e3ac-4e14-97bc-ca1c2780e3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:28.045068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 160/321] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:28.067593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213d8d6-8822-43c0-8566-9a1ae39387d0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:28.098867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 162/322] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:28.120368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d839-e3ac-4e14-97bc-ca1c2780e3ac None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:28.131407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:28.184411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213d8d6-8822-43c0-8566-9a1ae39387d0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:28.193105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:28.217782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f08870-fe21-4786-b6bb-3036b0c72316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:28.218419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f08870-fe21-4786-b6bb-3036b0c72316 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.218699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f08870-fe21-4786-b6bb-3036b0c72316 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.219017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f08870-fe21-4786-b6bb-3036b0c72316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.230522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d839-e3ac-4e14-97bc-ca1c2780e3ac None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:28.230812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f08870-fe21-4786-b6bb-3036b0c72316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-45f08870-fe21-4786-b6bb-3036b0c72316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:28.236508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:28.237540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:28.238542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:28.240247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 161/323] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:28.246143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f08870-fe21-4786-b6bb-3036b0c72316 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:28.269081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45314ac7-f9f9-4109-a022-52118f4b64cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:28.269989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45314ac7-f9f9-4109-a022-52118f4b64cd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.270433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45314ac7-f9f9-4109-a022-52118f4b64cd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.271002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45314ac7-f9f9-4109-a022-52118f4b64cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.273069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45314ac7-f9f9-4109-a022-52118f4b64cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:28.275027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45314ac7-f9f9-4109-a022-52118f4b64cd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:28.277235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 163/324] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:28.282858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45314ac7-f9f9-4109-a022-52118f4b64cd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:28.352295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f08870-fe21-4786-b6bb-3036b0c72316 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:28.365441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:28.381600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45314ac7-f9f9-4109-a022-52118f4b64cd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:28.385760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71666f96-39ca-4d70-8942-4ca846aa39ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:28.386366 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71666f96-39ca-4d70-8942-4ca846aa39ae None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.386642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71666f96-39ca-4d70-8942-4ca846aa39ae None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.386909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71666f96-39ca-4d70-8942-4ca846aa39ae None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.387648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71666f96-39ca-4d70-8942-4ca846aa39ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:28.388075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71666f96-39ca-4d70-8942-4ca846aa39ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:28.389496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71666f96-39ca-4d70-8942-4ca846aa39ae None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:28.397793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 162/325] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:28.402711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf5fa8-177d-46a9-8046-9900938e9be7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.403040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf5fa8-177d-46a9-8046-9900938e9be7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.403325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf5fa8-177d-46a9-8046-9900938e9be7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.404592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 163/326] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:28.405288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf5fa8-177d-46a9-8046-9900938e9be7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:28.416348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77aa20-36f0-4977-b036-0ab03d2fd2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:28.416945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77aa20-36f0-4977-b036-0ab03d2fd2b8 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.417222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77aa20-36f0-4977-b036-0ab03d2fd2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.417492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77aa20-36f0-4977-b036-0ab03d2fd2b8 None admin] PATH_INFO: `/v3/groups` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.418141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77aa20-36f0-4977-b036-0ab03d2fd2b8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:28.419596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77aa20-36f0-4977-b036-0ab03d2fd2b8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:28.426127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:28.439690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 164/327] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Aug 4 04:27:28 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:27:28.440900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5d01-4db9-4089-b1ec-7bc52b69b72f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.441188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5d01-4db9-4089-b1ec-7bc52b69b72f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.441464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d5d01-4db9-4089-b1ec-7bc52b69b72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.469508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1b2d5d01-4db9-4089-b1ec-7bc52b69b72f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:28.471120 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1b2d5d01-4db9-4089-b1ec-7bc52b69b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:28.530256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf5fa8-177d-46a9-8046-9900938e9be7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:28.566134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 165/328] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:28.568599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c26f6-e330-427d-bda7-29ec753adcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:28.569259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c26f6-e330-427d-bda7-29ec753adcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.569542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c26f6-e330-427d-bda7-29ec753adcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.569819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c26f6-e330-427d-bda7-29ec753adcf1 None admin] PATH_INFO: `/v3/users/7a74d1dfc98c48188c70dd033857e1d4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.571075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c26f6-e330-427d-bda7-29ec753adcf1 None admin] RBAC: Authorizing `identity:get_user(user_id=7a74d1dfc98c48188c70dd033857e1d4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:28.572542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c26f6-e330-427d-bda7-29ec753adcf1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:28.580064 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 164/329] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:28 2022] GET /identity/v3/users/7a74d1dfc98c48188c70dd033857e1d4 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:28.581098 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5d01-4db9-4089-b1ec-7bc52b69b72f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:28.582401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c26f6-e330-427d-bda7-29ec753adcf1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:28.633636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:28.701609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d5d01-4db9-4089-b1ec-7bc52b69b72f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:28.702835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c26f6-e330-427d-bda7-29ec753adcf1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:28.735824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:28.746023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29b63-27a1-4ad1-8129-04b072ae614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:28.746237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5402f5-a6fc-416d-b2df-11676cb1dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:28.746651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5402f5-a6fc-416d-b2df-11676cb1dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.746751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29b63-27a1-4ad1-8129-04b072ae614b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.746927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29b63-27a1-4ad1-8129-04b072ae614b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.747040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5402f5-a6fc-416d-b2df-11676cb1dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.747219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29b63-27a1-4ad1-8129-04b072ae614b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.747309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5402f5-a6fc-416d-b2df-11676cb1dbb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.748018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5402f5-a6fc-416d-b2df-11676cb1dbb9 None admin] RBAC: Adding query filter params (role.id=a8a24aac5beb466aa9599c299ab9ec1a, user.id=7a74d1dfc98c48188c70dd033857e1d4, scope.system=all) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:28.748325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5402f5-a6fc-416d-b2df-11676cb1dbb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:28.749756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5402f5-a6fc-416d-b2df-11676cb1dbb9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:28.765904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e29b63-27a1-4ad1-8129-04b072ae614b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:28.766622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 166/330] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Aug 4 04:27:28 2022] GET /identity/v3/role_assignments?user.id=7a74d1dfc98c48188c70dd033857e1d4&scope.system=all&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f9e29b63-27a1-4ad1-8129-04b072ae614b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:28.772596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:28.773534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:28.774337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 165/331] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:28.782115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5402f5-a6fc-416d-b2df-11676cb1dbb9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:28.905742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5402f5-a6fc-416d-b2df-11676cb1dbb9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:28.944089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4147367-783b-4f75-809f-f7fbf745cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:28.944706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4147367-783b-4f75-809f-f7fbf745cb38 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:28.945346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4147367-783b-4f75-809f-f7fbf745cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:28.945346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4147367-783b-4f75-809f-f7fbf745cb38 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:28.945987 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4147367-783b-4f75-809f-f7fbf745cb38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:28.946709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4147367-783b-4f75-809f-f7fbf745cb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:28.947659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4147367-783b-4f75-809f-f7fbf745cb38 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:28.956368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 167/332] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:28.961754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29b63-27a1-4ad1-8129-04b072ae614b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:29.079530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29b63-27a1-4ad1-8129-04b072ae614b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:29.081247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:29.122546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a142e-0097-4201-8f89-a0135e8ac63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:29.123267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a142e-0097-4201-8f89-a0135e8ac63c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:29.123635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a142e-0097-4201-8f89-a0135e8ac63c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:29.123820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a142e-0097-4201-8f89-a0135e8ac63c None admin] PATH_INFO: `/v3/users/99931dca609a460b8aab7116cb4297a9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:29.125008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a142e-0097-4201-8f89-a0135e8ac63c None admin] RBAC: Authorizing `identity:get_user(user_id=99931dca609a460b8aab7116cb4297a9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:29.126469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a142e-0097-4201-8f89-a0135e8ac63c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:29.128269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 166/333] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:28 2022] GET /identity/v3/users/99931dca609a460b8aab7116cb4297a9 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:29.134060 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4147367-783b-4f75-809f-f7fbf745cb38 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:29.201892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:29.268916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4147367-783b-4f75-809f-f7fbf745cb38 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:29.310782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5582a-4a13-4e31-bf63-d91b622677be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:29.311847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5582a-4a13-4e31-bf63-d91b622677be None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:29.312340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5582a-4a13-4e31-bf63-d91b622677be None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:29.312811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5582a-4a13-4e31-bf63-d91b622677be None admin] PATH_INFO: `/v3/system/users/99931dca609a460b8aab7116cb4297a9/roles/29d5cce45377405291fc52f29711ed58` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:29.314644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5582a-4a13-4e31-bf63-d91b622677be None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=99931dca609a460b8aab7116cb4297a9, role_id=29d5cce45377405291fc52f29711ed58)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:29.316333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5582a-4a13-4e31-bf63-d91b622677be None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:29.326116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 168/334] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Aug 4 04:27:29 2022] PUT /identity/v3/system/users/99931dca609a460b8aab7116cb4297a9/roles/29d5cce45377405291fc52f29711ed58 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:30.749421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f938fb9-713c-4b5f-8a9d-a1a8b3e93012 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:30.749937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f938fb9-713c-4b5f-8a9d-a1a8b3e93012 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:30.749937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f938fb9-713c-4b5f-8a9d-a1a8b3e93012 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:30.751869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 167/335] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:30.757552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0541b2-d893-4d3b-ac0b-35962edfa57b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:30.757928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0541b2-d893-4d3b-ac0b-35962edfa57b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:30.757928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0541b2-d893-4d3b-ac0b-35962edfa57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:30.784817 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-df0541b2-d893-4d3b-ac0b-35962edfa57b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:30.786001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-df0541b2-d893-4d3b-ac0b-35962edfa57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:30.874330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 169/336] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:30.905962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f938fb9-713c-4b5f-8a9d-a1a8b3e93012 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:31.024950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f938fb9-713c-4b5f-8a9d-a1a8b3e93012 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:31.065216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2331c69-98f2-4c1c-b2fb-beb93f3731ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:31.065864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331c69-98f2-4c1c-b2fb-beb93f3731ca None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:31.066152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331c69-98f2-4c1c-b2fb-beb93f3731ca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:31.066421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331c69-98f2-4c1c-b2fb-beb93f3731ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:31.083941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2331c69-98f2-4c1c-b2fb-beb93f3731ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a2331c69-98f2-4c1c-b2fb-beb93f3731ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:31.088978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:31.089864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:31.090634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 168/337] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:31.098488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0541b2-d893-4d3b-ac0b-35962edfa57b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:31.153921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:31.223772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0541b2-d893-4d3b-ac0b-35962edfa57b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:31.269191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673457d5-04c6-41ef-ab60-a236ac829479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:31.270185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673457d5-04c6-41ef-ab60-a236ac829479 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:31.270650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673457d5-04c6-41ef-ab60-a236ac829479 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:31.271148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673457d5-04c6-41ef-ab60-a236ac829479 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:31.272048 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673457d5-04c6-41ef-ab60-a236ac829479 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:31.272550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673457d5-04c6-41ef-ab60-a236ac829479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:31.274094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673457d5-04c6-41ef-ab60-a236ac829479 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:31.278583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca52d44-e8ee-4649-b8b4-f7b5d48a7b38 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:31.278794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca52d44-e8ee-4649-b8b4-f7b5d48a7b38 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:31.279098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca52d44-e8ee-4649-b8b4-f7b5d48a7b38 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:31.280727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 169/338] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:31.286150 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb48c-ef9d-49e6-82b3-7dfbcc61bc10 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:31.286408 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb48c-ef9d-49e6-82b3-7dfbcc61bc10 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:31.286688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb48c-ef9d-49e6-82b3-7dfbcc61bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:31.288833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 170/339] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:31.294405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673457d5-04c6-41ef-ab60-a236ac829479 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:31.328025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a06bb48c-ef9d-49e6-82b3-7dfbcc61bc10 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:31.329417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a06bb48c-ef9d-49e6-82b3-7dfbcc61bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:31.372870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:31.422172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673457d5-04c6-41ef-ab60-a236ac829479 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:31.424577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:31.453050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 170/340] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:31.484011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eebf21-fe77-42db-807b-ca4031472a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:31.484802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eebf21-fe77-42db-807b-ca4031472a0e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:31.485648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eebf21-fe77-42db-807b-ca4031472a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:31.485919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eebf21-fe77-42db-807b-ca4031472a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:31.495163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bb48c-ef9d-49e6-82b3-7dfbcc61bc10 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:31.581125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eebf21-fe77-42db-807b-ca4031472a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:31.582548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eebf21-fe77-42db-807b-ca4031472a0e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:31.664421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bb48c-ef9d-49e6-82b3-7dfbcc61bc10 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:31.727997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 171/341] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:31.732400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02c1ec-d5e0-4d6a-adc0-d4477121db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:31.733088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02c1ec-d5e0-4d6a-adc0-d4477121db24 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:31.733395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02c1ec-d5e0-4d6a-adc0-d4477121db24 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:31.733727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02c1ec-d5e0-4d6a-adc0-d4477121db24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:31.735575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eebf21-fe77-42db-807b-ca4031472a0e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:31.739280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:31.761307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02c1ec-d5e0-4d6a-adc0-d4477121db24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3c02c1ec-d5e0-4d6a-adc0-d4477121db24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:31.774655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:31.775622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:31.776828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 171/342] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:31.781650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02c1ec-d5e0-4d6a-adc0-d4477121db24 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:31.833987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:31.880096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eebf21-fe77-42db-807b-ca4031472a0e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:31.924147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795660-6608-45b3-8645-c2320da8f885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:31.924801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795660-6608-45b3-8645-c2320da8f885 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:31.925081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795660-6608-45b3-8645-c2320da8f885 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:31.925356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795660-6608-45b3-8645-c2320da8f885 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:31.926531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f795660-6608-45b3-8645-c2320da8f885 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:31.932437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f795660-6608-45b3-8645-c2320da8f885 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:31.934508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 172/343] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:31 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:31.941469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795660-6608-45b3-8645-c2320da8f885 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:31.961751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02c1ec-d5e0-4d6a-adc0-d4477121db24 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:32.047767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a18c2-76eb-457b-a826-755a54507aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:32.048409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a18c2-76eb-457b-a826-755a54507aec None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:32.048692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a18c2-76eb-457b-a826-755a54507aec None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:32.048964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a18c2-76eb-457b-a826-755a54507aec None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:32.049731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a18c2-76eb-457b-a826-755a54507aec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:32.050015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a18c2-76eb-457b-a826-755a54507aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:32.050462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:32.051558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a18c2-76eb-457b-a826-755a54507aec None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:32.065461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 172/344] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:32.071979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a18c2-76eb-457b-a826-755a54507aec None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:32.107831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795660-6608-45b3-8645-c2320da8f885 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:32.174120 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16bd02-e6a4-4a65-9992-fe2f6b883bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:32.175224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16bd02-e6a4-4a65-9992-fe2f6b883bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:32.175706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16bd02-e6a4-4a65-9992-fe2f6b883bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:32.176205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16bd02-e6a4-4a65-9992-fe2f6b883bf9 None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:32.186273 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16bd02-e6a4-4a65-9992-fe2f6b883bf9 None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:32.188252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16bd02-e6a4-4a65-9992-fe2f6b883bf9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:32.189072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:32.191996 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 173/345] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:31 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:32.198004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16bd02-e6a4-4a65-9992-fe2f6b883bf9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:32.217644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a18c2-76eb-457b-a826-755a54507aec None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:32.272261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ae82f-a3dd-45bf-96af-e0db34dca04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:32.272896 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae82f-a3dd-45bf-96af-e0db34dca04b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:32.273175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae82f-a3dd-45bf-96af-e0db34dca04b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:32.273446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae82f-a3dd-45bf-96af-e0db34dca04b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:32.338957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16bd02-e6a4-4a65-9992-fe2f6b883bf9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:32.400469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ae82f-a3dd-45bf-96af-e0db34dca04b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:32.402821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ae82f-a3dd-45bf-96af-e0db34dca04b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:32.409676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb28d29-c74e-47cd-b77d-cfd75d110e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:32.410637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb28d29-c74e-47cd-b77d-cfd75d110e4c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:32.411144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb28d29-c74e-47cd-b77d-cfd75d110e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:32.411615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb28d29-c74e-47cd-b77d-cfd75d110e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:32.412624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb28d29-c74e-47cd-b77d-cfd75d110e4c None admin] RBAC: Adding query filter params (group.id=e4133d2271684c42a87347f1fc44018f, role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:32.413220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb28d29-c74e-47cd-b77d-cfd75d110e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:32.416571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb28d29-c74e-47cd-b77d-cfd75d110e4c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:32.418600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:32.433186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 174/346] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:32 2022] GET /identity/v3/role_assignments?group.id=e4133d2271684c42a87347f1fc44018f&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:32.433186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fd319-a2fb-4ed2-ad21-e6ffeaed8ecf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:32.433186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fd319-a2fb-4ed2-ad21-e6ffeaed8ecf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:32.433186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fd319-a2fb-4ed2-ad21-e6ffeaed8ecf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:32.433186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 175/347] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:32.438585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb461e-543d-4c8d-b12a-b4d673452f18 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:32.438870 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb461e-543d-4c8d-b12a-b4d673452f18 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:32.439196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb461e-543d-4c8d-b12a-b4d673452f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:32.479399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e4fb461e-543d-4c8d-b12a-b4d673452f18 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:32.480640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e4fb461e-543d-4c8d-b12a-b4d673452f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:32.573367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 176/348] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:32.574465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b542e1b-0de4-467b-9e46-44460ea6af82 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:32.574749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b542e1b-0de4-467b-9e46-44460ea6af82 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:32.575218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b542e1b-0de4-467b-9e46-44460ea6af82 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:32.576960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 177/349] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:32.582270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:32.583430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f0010-5a58-4a3a-9549-4322a521f177 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:32.583711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f0010-5a58-4a3a-9549-4322a521f177 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:32.583985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f0010-5a58-4a3a-9549-4322a521f177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:32.606938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-985f0010-5a58-4a3a-9549-4322a521f177 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:32.608607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-985f0010-5a58-4a3a-9549-4322a521f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:32.640351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 173/350] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:32.642440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ae82f-a3dd-45bf-96af-e0db34dca04b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:32.701235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 178/351] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:32.702115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f0010-5a58-4a3a-9549-4322a521f177 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:32.774450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ae82f-a3dd-45bf-96af-e0db34dca04b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:32.817492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab2de9-d5aa-4ca8-9d56-561a85477437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:32.818372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab2de9-d5aa-4ca8-9d56-561a85477437 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:32.819550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab2de9-d5aa-4ca8-9d56-561a85477437 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:32.820154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab2de9-d5aa-4ca8-9d56-561a85477437 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:32.840748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab2de9-d5aa-4ca8-9d56-561a85477437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-78ab2de9-d5aa-4ca8-9d56-561a85477437 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:32.847895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:32.849025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:32.850019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:32.856191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:32.856661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 174/352] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:32.857477 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab2de9-d5aa-4ca8-9d56-561a85477437 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:32.936183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f0010-5a58-4a3a-9549-4322a521f177 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:32.955368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:33.017175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31748f-5444-4b85-9867-afb43ddd77e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:33.018308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31748f-5444-4b85-9867-afb43ddd77e2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.018602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31748f-5444-4b85-9867-afb43ddd77e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.018881 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31748f-5444-4b85-9867-afb43ddd77e2 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.020836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31748f-5444-4b85-9867-afb43ddd77e2 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:33.022558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31748f-5444-4b85-9867-afb43ddd77e2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:33.025653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 179/353] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:32 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:33.026774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31748f-5444-4b85-9867-afb43ddd77e2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:33.052012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab2de9-d5aa-4ca8-9d56-561a85477437 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:33.102689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c399130-a2dd-433d-88f6-c6a68b20c733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:33.103734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c399130-a2dd-433d-88f6-c6a68b20c733 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.104484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c399130-a2dd-433d-88f6-c6a68b20c733 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.104958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c399130-a2dd-433d-88f6-c6a68b20c733 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.120070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c399130-a2dd-433d-88f6-c6a68b20c733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7c399130-a2dd-433d-88f6-c6a68b20c733 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:33.126472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:33.127657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 04:27:33.128448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:33.135292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 175/354] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:33.136892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4da62-5267-4720-a3f4-b4d2e40278c2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.137395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4da62-5267-4720-a3f4-b4d2e40278c2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.137886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4da62-5267-4720-a3f4-b4d2e40278c2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.139702 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 176/355] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:33.140615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4da62-5267-4720-a3f4-b4d2e40278c2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:33.147813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31748f-5444-4b85-9867-afb43ddd77e2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:33.188591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:33.200393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8b350-19f2-4aaa-9c91-532772dad1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:33.201021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8b350-19f2-4aaa-9c91-532772dad1dc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.201300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8b350-19f2-4aaa-9c91-532772dad1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.201569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8b350-19f2-4aaa-9c91-532772dad1dc None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.202287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8b350-19f2-4aaa-9c91-532772dad1dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:33.202587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8b350-19f2-4aaa-9c91-532772dad1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:33.204538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8b350-19f2-4aaa-9c91-532772dad1dc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:33.213302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 180/356] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:33.214484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfbe1d-9d4f-4ea2-bb78-146fa64139a2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.214771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfbe1d-9d4f-4ea2-bb78-146fa64139a2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.215925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfbe1d-9d4f-4ea2-bb78-146fa64139a2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.216434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 181/357] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:33.218518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfbe1d-9d4f-4ea2-bb78-146fa64139a2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:33.275998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4da62-5267-4720-a3f4-b4d2e40278c2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:33.277795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:33.324116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1caed-068a-455e-8592-8310a164a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:33.324768 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1caed-068a-455e-8592-8310a164a64d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.325047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1caed-068a-455e-8592-8310a164a64d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.325322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1caed-068a-455e-8592-8310a164a64d None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.326456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1caed-068a-455e-8592-8310a164a64d None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:33.327971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1caed-068a-455e-8592-8310a164a64d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:33.330087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 177/358] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:33 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:33.331217 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954bb2c-64e2-41bf-9f47-3bd00df11b37 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.331497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954bb2c-64e2-41bf-9f47-3bd00df11b37 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.331767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954bb2c-64e2-41bf-9f47-3bd00df11b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.352441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5954bb2c-64e2-41bf-9f47-3bd00df11b37 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:33.353495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfbe1d-9d4f-4ea2-bb78-146fa64139a2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:33.353794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5954bb2c-64e2-41bf-9f47-3bd00df11b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:33.404604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943728e0-5f9a-4c3f-9b04-8603c0a97d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:33.404862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943728e0-5f9a-4c3f-9b04-8603c0a97d2a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.405139 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943728e0-5f9a-4c3f-9b04-8603c0a97d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.405434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943728e0-5f9a-4c3f-9b04-8603c0a97d2a None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.406146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943728e0-5f9a-4c3f-9b04-8603c0a97d2a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:33.406446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943728e0-5f9a-4c3f-9b04-8603c0a97d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:33.407941 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943728e0-5f9a-4c3f-9b04-8603c0a97d2a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:33.421844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 182/359] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:33.424055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943728e0-5f9a-4c3f-9b04-8603c0a97d2a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:33.454429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 178/360] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:33.455751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a2d05-3627-43f4-a0cc-1f760c06b06f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.456052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a2d05-3627-43f4-a0cc-1f760c06b06f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.456296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a2d05-3627-43f4-a0cc-1f760c06b06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.474586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-443a2d05-3627-43f4-a0cc-1f760c06b06f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:33.475726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-443a2d05-3627-43f4-a0cc-1f760c06b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:33.493303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:33.555574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 179/361] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:33.563209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a2d05-3627-43f4-a0cc-1f760c06b06f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:33.564194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943728e0-5f9a-4c3f-9b04-8603c0a97d2a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:33.591712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:33.622724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e9a1-c691-442b-985e-8cfa4a3f1d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:33.623516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e9a1-c691-442b-985e-8cfa4a3f1d66 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.623674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e9a1-c691-442b-985e-8cfa4a3f1d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.623950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e9a1-c691-442b-985e-8cfa4a3f1d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.700869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a2d05-3627-43f4-a0cc-1f760c06b06f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:33.714609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e9a1-c691-442b-985e-8cfa4a3f1d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:33.716289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e9a1-c691-442b-985e-8cfa4a3f1d66 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:33.743428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b662-4dc4-41ba-9458-0224eac6f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:33.743428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b662-4dc4-41ba-9458-0224eac6f297 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.743671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b662-4dc4-41ba-9458-0224eac6f297 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.743780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b662-4dc4-41ba-9458-0224eac6f297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.744579 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b662-4dc4-41ba-9458-0224eac6f297 None admin] RBAC: Adding query filter params (group.id=e4133d2271684c42a87347f1fc44018f, role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:33.744888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b662-4dc4-41ba-9458-0224eac6f297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:33.746318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b662-4dc4-41ba-9458-0224eac6f297 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:33.756682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 180/362] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:33 2022] GET /identity/v3/role_assignments?group.id=e4133d2271684c42a87347f1fc44018f&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:33.757862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b662-4dc4-41ba-9458-0224eac6f297 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:33.784173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:33.850774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 183/363] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:33.852043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e9a1-c691-442b-985e-8cfa4a3f1d66 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:33.886271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:33.897059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b662-4dc4-41ba-9458-0224eac6f297 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:33.945723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe9fc8-f973-449a-a520-ff61d433ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:33.946641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe9fc8-f973-449a-a520-ff61d433ac9a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:33.947108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe9fc8-f973-449a-a520-ff61d433ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:33.948147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe9fc8-f973-449a-a520-ff61d433ac9a None admin] PATH_INFO: `/v3/users/99931dca609a460b8aab7116cb4297a9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:33.949652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe9fc8-f973-449a-a520-ff61d433ac9a None admin] RBAC: Authorizing `identity:get_user(user_id=99931dca609a460b8aab7116cb4297a9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:33.951758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe9fc8-f973-449a-a520-ff61d433ac9a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:33.955120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 181/364] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:27:33 2022] GET /identity/v3/users/99931dca609a460b8aab7116cb4297a9 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:33.956304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe9fc8-f973-449a-a520-ff61d433ac9a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:33.985359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e9a1-c691-442b-985e-8cfa4a3f1d66 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:34.033050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d77d2-ff39-4375-9d87-aafe4eea6293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:34.033780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d77d2-ff39-4375-9d87-aafe4eea6293 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:34.034153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d77d2-ff39-4375-9d87-aafe4eea6293 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:34.034668 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d77d2-ff39-4375-9d87-aafe4eea6293 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:34.048053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d77d2-ff39-4375-9d87-aafe4eea6293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-298d77d2-ff39-4375-9d87-aafe4eea6293 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:34.055432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:34.056454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:34.057240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 184/365] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:34.058013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d77d2-ff39-4375-9d87-aafe4eea6293 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:34.077893 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:34.095736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe9fc8-f973-449a-a520-ff61d433ac9a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:34.132941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dd2f2-830a-4aa1-aa2f-9d905d7b16de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:34.133918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dd2f2-830a-4aa1-aa2f-9d905d7b16de None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:34.134392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dd2f2-830a-4aa1-aa2f-9d905d7b16de None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:34.134856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dd2f2-830a-4aa1-aa2f-9d905d7b16de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:34.148822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dd2f2-830a-4aa1-aa2f-9d905d7b16de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a01dd2f2-830a-4aa1-aa2f-9d905d7b16de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:34.154663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:34.155813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:34.156604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:34.159682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 182/366] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:34.165570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dd2f2-830a-4aa1-aa2f-9d905d7b16de None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:34.186375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d77d2-ff39-4375-9d87-aafe4eea6293 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:34.205515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:34.233802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b3469-5106-40a3-8081-4e530c4f7d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:34.234627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b3469-5106-40a3-8081-4e530c4f7d0b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:34.234735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b3469-5106-40a3-8081-4e530c4f7d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:34.235541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b3469-5106-40a3-8081-4e530c4f7d0b None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:34.236772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b3469-5106-40a3-8081-4e530c4f7d0b None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:34.238273 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b3469-5106-40a3-8081-4e530c4f7d0b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:34.239904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 185/367] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:34 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:34.240689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b3469-5106-40a3-8081-4e530c4f7d0b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:34.307758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dd2f2-830a-4aa1-aa2f-9d905d7b16de None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:34.341605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:34.353391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8f9cd-6e50-4287-8696-8956ad81fc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:34.354067 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f9cd-6e50-4287-8696-8956ad81fc34 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:34.354348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f9cd-6e50-4287-8696-8956ad81fc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:34.354617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f9cd-6e50-4287-8696-8956ad81fc34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:34.355456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8f9cd-6e50-4287-8696-8956ad81fc34 None admin] RBAC: Adding query filter params (role.id=29d5cce45377405291fc52f29711ed58, user.id=99931dca609a460b8aab7116cb4297a9, scope.system=all) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:34.355763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8f9cd-6e50-4287-8696-8956ad81fc34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:34.357216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8f9cd-6e50-4287-8696-8956ad81fc34 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:34.366245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b3469-5106-40a3-8081-4e530c4f7d0b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:34.373502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 183/368] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Aug 4 04:27:34 2022] GET /identity/v3/role_assignments?user.id=99931dca609a460b8aab7116cb4297a9&scope.system=all&role.id=29d5cce45377405291fc52f29711ed58 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:34.374351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8f9cd-6e50-4287-8696-8956ad81fc34 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:34.410258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ad734-8b8a-41d3-8c02-0c8d7352db96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:34.410898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad734-8b8a-41d3-8c02-0c8d7352db96 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:34.411235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad734-8b8a-41d3-8c02-0c8d7352db96 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:34.411501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad734-8b8a-41d3-8c02-0c8d7352db96 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:34.412232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ad734-8b8a-41d3-8c02-0c8d7352db96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:34.412529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ad734-8b8a-41d3-8c02-0c8d7352db96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:34.414004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ad734-8b8a-41d3-8c02-0c8d7352db96 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:34.425456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 186/369] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:34.426323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ad734-8b8a-41d3-8c02-0c8d7352db96 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:34.564520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ad734-8b8a-41d3-8c02-0c8d7352db96 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:34.606538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9da4d-6f42-4823-a132-8ba71c5ab6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:34.607288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9da4d-6f42-4823-a132-8ba71c5ab6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:34.607572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9da4d-6f42-4823-a132-8ba71c5ab6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:34.607848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9da4d-6f42-4823-a132-8ba71c5ab6f8 None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:34.609699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9da4d-6f42-4823-a132-8ba71c5ab6f8 None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:34.611265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9da4d-6f42-4823-a132-8ba71c5ab6f8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:34.613892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 187/370] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:34 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:34.614698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9da4d-6f42-4823-a132-8ba71c5ab6f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:34.621824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:34.630115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:34.666432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8f9cd-6e50-4287-8696-8956ad81fc34 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:34.710471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e673607-7d5b-4c2a-a58c-8aef54b3d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:34.711131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e673607-7d5b-4c2a-a58c-8aef54b3d560 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:34.711413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e673607-7d5b-4c2a-a58c-8aef54b3d560 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:34.711688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e673607-7d5b-4c2a-a58c-8aef54b3d560 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:34.712412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e673607-7d5b-4c2a-a58c-8aef54b3d560 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:34.712715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e673607-7d5b-4c2a-a58c-8aef54b3d560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:34.714107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e673607-7d5b-4c2a-a58c-8aef54b3d560 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:34.724685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 184/371] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:34.730839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e673607-7d5b-4c2a-a58c-8aef54b3d560 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:34.753005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9da4d-6f42-4823-a132-8ba71c5ab6f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:34.810469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42e514-1c13-41c9-acf7-2bc978ecd7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:34.811205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42e514-1c13-41c9-acf7-2bc978ecd7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:34.811532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42e514-1c13-41c9-acf7-2bc978ecd7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:34.811809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42e514-1c13-41c9-acf7-2bc978ecd7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:34.903209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e673607-7d5b-4c2a-a58c-8aef54b3d560 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:34.917470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42e514-1c13-41c9-acf7-2bc978ecd7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:34.919163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42e514-1c13-41c9-acf7-2bc978ecd7e6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:34.931063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:34.956476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f006b-e325-4f63-b4cf-94d69c811d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:34.957102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f006b-e325-4f63-b4cf-94d69c811d72 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:34.957382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f006b-e325-4f63-b4cf-94d69c811d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:34.957663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f006b-e325-4f63-b4cf-94d69c811d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:34.958469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f006b-e325-4f63-b4cf-94d69c811d72 None admin] RBAC: Adding query filter params (group.id=e4133d2271684c42a87347f1fc44018f, role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=70bd38425cfc4d7aba3d67244f967485) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:34.958780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f006b-e325-4f63-b4cf-94d69c811d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:34.960333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f006b-e325-4f63-b4cf-94d69c811d72 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:34.966293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 185/372] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:34 2022] GET /identity/v3/role_assignments?group.id=e4133d2271684c42a87347f1fc44018f&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:34.967346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f006b-e325-4f63-b4cf-94d69c811d72 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:34.977301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:35.047459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 188/373] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:35.049531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e3d82-b45b-4a18-91f8-ed3bfd758788 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:35.049987 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e3d82-b45b-4a18-91f8-ed3bfd758788 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:35.050481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e3d82-b45b-4a18-91f8-ed3bfd758788 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:35.052088 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 189/374] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:35.057297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e3d82-b45b-4a18-91f8-ed3bfd758788 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:35.106501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f006b-e325-4f63-b4cf-94d69c811d72 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:35.155968 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55fb21-8598-4c55-912b-be44a982b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:35.156992 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55fb21-8598-4c55-912b-be44a982b1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:35.157484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55fb21-8598-4c55-912b-be44a982b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:35.157971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55fb21-8598-4c55-912b-be44a982b1d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:35.190393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e3d82-b45b-4a18-91f8-ed3bfd758788 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:35.200499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:35.228673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc307c-798e-44a5-8d8c-1f2cd2da0ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:35.229099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc307c-798e-44a5-8d8c-1f2cd2da0ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:35.229381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc307c-798e-44a5-8d8c-1f2cd2da0ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:35.229651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc307c-798e-44a5-8d8c-1f2cd2da0ca2 None admin] PATH_INFO: `/v3/projects/998b35aeaf484d148461559c217775c3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:35.230969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc307c-798e-44a5-8d8c-1f2cd2da0ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=998b35aeaf484d148461559c217775c3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:35.232352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc307c-798e-44a5-8d8c-1f2cd2da0ca2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:35.234461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 190/375] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:35 2022] GET /identity/v3/projects/998b35aeaf484d148461559c217775c3 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:35.241495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266b9c-9aa2-4afa-81de-b2bb2c1f11ad None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:35.241797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266b9c-9aa2-4afa-81de-b2bb2c1f11ad None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:35.242090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266b9c-9aa2-4afa-81de-b2bb2c1f11ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:35.248772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55fb21-8598-4c55-912b-be44a982b1d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:35.251161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55fb21-8598-4c55-912b-be44a982b1d9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:35.260120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:35.260996 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-16266b9c-9aa2-4afa-81de-b2bb2c1f11ad None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:35.261922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-16266b9c-9aa2-4afa-81de-b2bb2c1f11ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:35.337206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 191/376] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:35.338057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266b9c-9aa2-4afa-81de-b2bb2c1f11ad None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:35.367881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 186/377] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:35.374131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55fb21-8598-4c55-912b-be44a982b1d9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:35.461810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266b9c-9aa2-4afa-81de-b2bb2c1f11ad None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:35.472119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:35.487795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55fb21-8598-4c55-912b-be44a982b1d9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:35.499292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:35.520921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c43f7f-5107-4c44-a946-aeb9400981dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:35.521639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c43f7f-5107-4c44-a946-aeb9400981dd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:35.521914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c43f7f-5107-4c44-a946-aeb9400981dd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:35.522631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c43f7f-5107-4c44-a946-aeb9400981dd None admin] PATH_INFO: `/v3/groups/bd828e8e825a49f0ac27416b9ec7b42a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:35.529892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c43f7f-5107-4c44-a946-aeb9400981dd None admin] RBAC: Authorizing `identity:get_group(group_id=bd828e8e825a49f0ac27416b9ec7b42a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:35.531677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c43f7f-5107-4c44-a946-aeb9400981dd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:35.534843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 192/378] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:35 2022] GET /identity/v3/groups/bd828e8e825a49f0ac27416b9ec7b42a => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:35.535957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c43f7f-5107-4c44-a946-aeb9400981dd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:35.545563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d862937-7999-4bbd-a93d-43a040da133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:35.546474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d862937-7999-4bbd-a93d-43a040da133d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:35.546758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d862937-7999-4bbd-a93d-43a040da133d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:35.547086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d862937-7999-4bbd-a93d-43a040da133d None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:35.550033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d862937-7999-4bbd-a93d-43a040da133d None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:35.553368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d862937-7999-4bbd-a93d-43a040da133d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:35.555535 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 187/379] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:35 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:35.556373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d862937-7999-4bbd-a93d-43a040da133d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:35.669943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c43f7f-5107-4c44-a946-aeb9400981dd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:35.685225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d862937-7999-4bbd-a93d-43a040da133d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:35.715715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a6fb5-ef60-4b13-b691-32d49173d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:35.716349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a6fb5-ef60-4b13-b691-32d49173d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:35.716634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a6fb5-ef60-4b13-b691-32d49173d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:35.716907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a6fb5-ef60-4b13-b691-32d49173d2d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:35.729145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a6fb5-ef60-4b13-b691-32d49173d2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:35.732262 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82a243-6b50-4d3e-9a94-340da0595a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:35.732881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82a243-6b50-4d3e-9a94-340da0595a87 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:35.733157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82a243-6b50-4d3e-9a94-340da0595a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:35.733426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82a243-6b50-4d3e-9a94-340da0595a87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:35.734223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82a243-6b50-4d3e-9a94-340da0595a87 None admin] RBAC: Adding query filter params (group.id=bd828e8e825a49f0ac27416b9ec7b42a, role.id=c1429555635349208e8b2bd908436746, scope.project.id=998b35aeaf484d148461559c217775c3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:35.737265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82a243-6b50-4d3e-9a94-340da0595a87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-391a6fb5-ef60-4b13-b691-32d49173d2d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:35.738346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:35.739286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:35.740126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:35.740762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82a243-6b50-4d3e-9a94-340da0595a87 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:35.740837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 193/380] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:35.740837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a6fb5-ef60-4b13-b691-32d49173d2d8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:35.751213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 188/381] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:35 2022] GET /identity/v3/role_assignments?group.id=bd828e8e825a49f0ac27416b9ec7b42a&scope.project.id=998b35aeaf484d148461559c217775c3&role.id=c1429555635349208e8b2bd908436746 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:35.752259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82a243-6b50-4d3e-9a94-340da0595a87 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:35.807264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:35.839360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:35.959807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a6fb5-ef60-4b13-b691-32d49173d2d8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:35.978943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82a243-6b50-4d3e-9a94-340da0595a87 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:36.017300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904f867-12bb-498a-a5a9-0f516523484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:36.017954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904f867-12bb-498a-a5a9-0f516523484e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.018233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904f867-12bb-498a-a5a9-0f516523484e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.018501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904f867-12bb-498a-a5a9-0f516523484e None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.023761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904f867-12bb-498a-a5a9-0f516523484e None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:36.025551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904f867-12bb-498a-a5a9-0f516523484e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:36.027212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 194/382] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:35 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:36.033169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904f867-12bb-498a-a5a9-0f516523484e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:36.036862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d43af4-865b-4ef1-88db-b31715578e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:36.037491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43af4-865b-4ef1-88db-b31715578e8d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.037767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43af4-865b-4ef1-88db-b31715578e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.038038 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d43af4-865b-4ef1-88db-b31715578e8d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.038882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d43af4-865b-4ef1-88db-b31715578e8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:36.039211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d43af4-865b-4ef1-88db-b31715578e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:36.040699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d43af4-865b-4ef1-88db-b31715578e8d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:36.053553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 189/383] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:36.056453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d43af4-865b-4ef1-88db-b31715578e8d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:36.161263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:36.166178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904f867-12bb-498a-a5a9-0f516523484e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:36.180326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:36.185259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d43af4-865b-4ef1-88db-b31715578e8d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:36.202356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ff5b9-f36d-43c0-a48a-74ef1e23b161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:36.202998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ff5b9-f36d-43c0-a48a-74ef1e23b161 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.203283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ff5b9-f36d-43c0-a48a-74ef1e23b161 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.203553 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ff5b9-f36d-43c0-a48a-74ef1e23b161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.204888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ff5b9-f36d-43c0-a48a-74ef1e23b161 None admin] RBAC: Adding query filter params (group.id=e4133d2271684c42a87347f1fc44018f, role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=70bd38425cfc4d7aba3d67244f967485) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:36.205195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ff5b9-f36d-43c0-a48a-74ef1e23b161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:36.206628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ff5b9-f36d-43c0-a48a-74ef1e23b161 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:36.212705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 195/384] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:36 2022] GET /identity/v3/role_assignments?group.id=e4133d2271684c42a87347f1fc44018f&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:36.229481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82d277-6871-44df-b5ab-33b3d852af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:36.230383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82d277-6871-44df-b5ab-33b3d852af68 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.230839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82d277-6871-44df-b5ab-33b3d852af68 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.231342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82d277-6871-44df-b5ab-33b3d852af68 None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.232803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82d277-6871-44df-b5ab-33b3d852af68 None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:36.234422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82d277-6871-44df-b5ab-33b3d852af68 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:36.237276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 190/385] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:36 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:36.243173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ff5b9-f36d-43c0-a48a-74ef1e23b161 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:36.373384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ff5b9-f36d-43c0-a48a-74ef1e23b161 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:36.409629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e35eeb-639b-45b7-ba59-4ad25f9a0762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:36.410282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e35eeb-639b-45b7-ba59-4ad25f9a0762 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.410563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e35eeb-639b-45b7-ba59-4ad25f9a0762 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.410837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e35eeb-639b-45b7-ba59-4ad25f9a0762 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.412070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e35eeb-639b-45b7-ba59-4ad25f9a0762 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:36.413499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e35eeb-639b-45b7-ba59-4ad25f9a0762 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:36.415434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3177b-6376-476e-8f54-abe6ccacc350 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.415584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 196/386] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:36 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:36.416052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3177b-6376-476e-8f54-abe6ccacc350 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.416401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3177b-6376-476e-8f54-abe6ccacc350 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.417926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 191/387] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:36.423664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298db187-08e9-45e2-9af0-e75b536a8c2b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.424181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298db187-08e9-45e2-9af0-e75b536a8c2b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.424516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3177b-6376-476e-8f54-abe6ccacc350 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:36.424827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298db187-08e9-45e2-9af0-e75b536a8c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.443646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-298db187-08e9-45e2-9af0-e75b536a8c2b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:36.445213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-298db187-08e9-45e2-9af0-e75b536a8c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:36.473022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:36.521314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 197/388] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:36.560628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298db187-08e9-45e2-9af0-e75b536a8c2b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:36.563791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3177b-6376-476e-8f54-abe6ccacc350 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:36.604097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf375feb-4ab9-45c0-b2aa-bb16786cc094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:36.605154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf375feb-4ab9-45c0-b2aa-bb16786cc094 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.605285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf375feb-4ab9-45c0-b2aa-bb16786cc094 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.605456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf375feb-4ab9-45c0-b2aa-bb16786cc094 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/groups/e4133d2271684c42a87347f1fc44018f/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.607608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf375feb-4ab9-45c0-b2aa-bb16786cc094 None admin] RBAC: Authorizing `identity:create_grant(project_id=e63992ad2ad44ebd85dc7df2b2522b34, group_id=e4133d2271684c42a87347f1fc44018f, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:36.609340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf375feb-4ab9-45c0-b2aa-bb16786cc094 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:36.636185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 192/389] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Aug 4 04:27:36 2022] PUT /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/groups/e4133d2271684c42a87347f1fc44018f/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:36.686102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298db187-08e9-45e2-9af0-e75b536a8c2b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:36.730609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64987692-03d3-4c6a-8c06-48e5dcbbea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:36.731695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987692-03d3-4c6a-8c06-48e5dcbbea94 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.732194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987692-03d3-4c6a-8c06-48e5dcbbea94 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.732667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64987692-03d3-4c6a-8c06-48e5dcbbea94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.753010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64987692-03d3-4c6a-8c06-48e5dcbbea94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-64987692-03d3-4c6a-8c06-48e5dcbbea94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:36.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:36.759449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:36.760229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:36.767131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 198/390] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:36.771453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf375feb-4ab9-45c0-b2aa-bb16786cc094 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:36.825525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:36.928706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf375feb-4ab9-45c0-b2aa-bb16786cc094 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:36.971722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e71d8-f15d-4a36-abff-5c8726232dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:36.972345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e71d8-f15d-4a36-abff-5c8726232dec None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:36.972627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e71d8-f15d-4a36-abff-5c8726232dec None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:36.972926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e71d8-f15d-4a36-abff-5c8726232dec None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:36.973700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e71d8-f15d-4a36-abff-5c8726232dec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:36.974008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e71d8-f15d-4a36-abff-5c8726232dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:36.975414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e71d8-f15d-4a36-abff-5c8726232dec None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:36.984764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 193/391] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:36.990262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64987692-03d3-4c6a-8c06-48e5dcbbea94 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:37.027650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:37.134965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64987692-03d3-4c6a-8c06-48e5dcbbea94 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:37.185690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a314f-cf55-4d3f-ab4f-810ac858ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:37.186358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a314f-cf55-4d3f-ab4f-810ac858ae53 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:37.186599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a314f-cf55-4d3f-ab4f-810ac858ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:37.186853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a314f-cf55-4d3f-ab4f-810ac858ae53 None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:37.188109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a314f-cf55-4d3f-ab4f-810ac858ae53 None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:37.189552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a314f-cf55-4d3f-ab4f-810ac858ae53 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:37.191478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 199/392] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:36 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:37.196939 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e71d8-f15d-4a36-abff-5c8726232dec None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:37.322977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:37.337055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e71d8-f15d-4a36-abff-5c8726232dec None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:37.381061 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4a56b-9606-4132-b94c-a5e8900e6452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:37.381717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4a56b-9606-4132-b94c-a5e8900e6452 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:37.381993 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4a56b-9606-4132-b94c-a5e8900e6452 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:37.382263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4a56b-9606-4132-b94c-a5e8900e6452 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:37.383455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4a56b-9606-4132-b94c-a5e8900e6452 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:37.384869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4a56b-9606-4132-b94c-a5e8900e6452 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:37.386720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 194/393] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:37 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:37.392701 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a314f-cf55-4d3f-ab4f-810ac858ae53 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:37.551588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:37.566264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a314f-cf55-4d3f-ab4f-810ac858ae53 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:37.580924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04db58-2dd2-4470-a889-046cbec55bbe None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:37.581183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04db58-2dd2-4470-a889-046cbec55bbe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:37.581393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04db58-2dd2-4470-a889-046cbec55bbe None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:37.582739 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 195/394] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:37.589824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22555fa-5d9f-46e2-9d56-48aa2b41d879 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:37.590110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22555fa-5d9f-46e2-9d56-48aa2b41d879 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:37.590379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22555fa-5d9f-46e2-9d56-48aa2b41d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:37.618014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e22555fa-5d9f-46e2-9d56-48aa2b41d879 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:37.619459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e22555fa-5d9f-46e2-9d56-48aa2b41d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:37.661041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75daad-f83b-4c68-aad0-0308edc3e8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:37.661725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75daad-f83b-4c68-aad0-0308edc3e8e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:37.662002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75daad-f83b-4c68-aad0-0308edc3e8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:37.662273 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75daad-f83b-4c68-aad0-0308edc3e8e4 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/groups/e4133d2271684c42a87347f1fc44018f/roles/22759f25d96f4063a7d10f7048d7b3bd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:37.668023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75daad-f83b-4c68-aad0-0308edc3e8e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e63992ad2ad44ebd85dc7df2b2522b34, group_id=e4133d2271684c42a87347f1fc44018f, role_id=22759f25d96f4063a7d10f7048d7b3bd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:37.669456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75daad-f83b-4c68-aad0-0308edc3e8e4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:37.699321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 200/395] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Aug 4 04:27:37 2022] PUT /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34/groups/e4133d2271684c42a87347f1fc44018f/roles/22759f25d96f4063a7d10f7048d7b3bd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:37.757838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 196/396] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:37.795783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75daad-f83b-4c68-aad0-0308edc3e8e4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:37.941722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75daad-f83b-4c68-aad0-0308edc3e8e4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:37.985855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205085-3256-4db3-a488-2235120d515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:37.986508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205085-3256-4db3-a488-2235120d515a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:37.986790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205085-3256-4db3-a488-2235120d515a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:37.987103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205085-3256-4db3-a488-2235120d515a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:37.997811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed205085-3256-4db3-a488-2235120d515a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-ed205085-3256-4db3-a488-2235120d515a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:38.003487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:38.004349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:38.005106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 201/397] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:38.010392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22555fa-5d9f-46e2-9d56-48aa2b41d879 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:38.108114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:38.121109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22555fa-5d9f-46e2-9d56-48aa2b41d879 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:38.158888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2d850-7602-4456-b279-35dfb872dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:38.159558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2d850-7602-4456-b279-35dfb872dd9b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:38.159837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2d850-7602-4456-b279-35dfb872dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:38.160112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2d850-7602-4456-b279-35dfb872dd9b None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:38.160898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2d850-7602-4456-b279-35dfb872dd9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:38.161201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2d850-7602-4456-b279-35dfb872dd9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:38.162580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2d850-7602-4456-b279-35dfb872dd9b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:38.172070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 197/398] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:38.180069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205085-3256-4db3-a488-2235120d515a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:38.193128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:38.304698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205085-3256-4db3-a488-2235120d515a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:38.353311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24463257-282d-42db-a208-1f700747862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:38.353961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24463257-282d-42db-a208-1f700747862b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:38.354238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24463257-282d-42db-a208-1f700747862b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:38.354512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24463257-282d-42db-a208-1f700747862b None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:38.355806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24463257-282d-42db-a208-1f700747862b None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:38.357313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24463257-282d-42db-a208-1f700747862b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:38.358919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 202/399] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:38 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:38.365173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2d850-7602-4456-b279-35dfb872dd9b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:38.410750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eca98-b2a7-4534-8619-561de70c9eb9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:38.411107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eca98-b2a7-4534-8619-561de70c9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:38.411339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eca98-b2a7-4534-8619-561de70c9eb9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:38.413013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 203/400] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:38.418122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f849a-b1f4-4d1c-92ce-5bf0403b677b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:38.418406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f849a-b1f4-4d1c-92ce-5bf0403b677b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:38.418683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f849a-b1f4-4d1c-92ce-5bf0403b677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:38.460147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f46f849a-b1f4-4d1c-92ce-5bf0403b677b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:38.461285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f46f849a-b1f4-4d1c-92ce-5bf0403b677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:38.478760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2d850-7602-4456-b279-35dfb872dd9b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:38.513984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4b50-6a96-4f6a-8d38-65e4a7b32216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:38.514629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4b50-6a96-4f6a-8d38-65e4a7b32216 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:38.514915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4b50-6a96-4f6a-8d38-65e4a7b32216 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:38.515215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4b50-6a96-4f6a-8d38-65e4a7b32216 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:38.516929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4b50-6a96-4f6a-8d38-65e4a7b32216 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:38.518470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4b50-6a96-4f6a-8d38-65e4a7b32216 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:38.520229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 198/401] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:38 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:38.525970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4b50-6a96-4f6a-8d38-65e4a7b32216 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:38.549257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:38.607430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 204/402] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:38.631199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4b50-6a96-4f6a-8d38-65e4a7b32216 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:38.638507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f849a-b1f4-4d1c-92ce-5bf0403b677b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:38.651591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:38.672887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ecc6a-cb98-4b0d-bce1-b91f2dfa3827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:38.673567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ecc6a-cb98-4b0d-bce1-b91f2dfa3827 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:38.673846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ecc6a-cb98-4b0d-bce1-b91f2dfa3827 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:38.674123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ecc6a-cb98-4b0d-bce1-b91f2dfa3827 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485/groups/e4133d2271684c42a87347f1fc44018f/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:38.680189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ecc6a-cb98-4b0d-bce1-b91f2dfa3827 None admin] RBAC: Authorizing `identity:create_grant(project_id=70bd38425cfc4d7aba3d67244f967485, group_id=e4133d2271684c42a87347f1fc44018f, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:38.681635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ecc6a-cb98-4b0d-bce1-b91f2dfa3827 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:38.701733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 199/403] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Aug 4 04:27:38 2022] PUT /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485/groups/e4133d2271684c42a87347f1fc44018f/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:27:38.813838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f849a-b1f4-4d1c-92ce-5bf0403b677b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:38.862420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ee588-4ae6-49b6-aa38-96a10c54a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:38.863104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ee588-4ae6-49b6-aa38-96a10c54a530 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:38.863402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ee588-4ae6-49b6-aa38-96a10c54a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:38.863663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ee588-4ae6-49b6-aa38-96a10c54a530 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:38.873749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf190d-b211-4c6c-a903-0092822c0b92 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:38.874058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf190d-b211-4c6c-a903-0092822c0b92 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:38.874306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf190d-b211-4c6c-a903-0092822c0b92 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:38.875410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ee588-4ae6-49b6-aa38-96a10c54a530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:38.876504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 200/404] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b76ee588-4ae6-49b6-aa38-96a10c54a530 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:38.881465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:38.882367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:38.883173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:38.883789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ffe1d-92f8-4184-a7ea-899888e813e6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:38.883789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ffe1d-92f8-4184-a7ea-899888e813e6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:38.883789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ffe1d-92f8-4184-a7ea-899888e813e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:38.883974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 205/405] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:38.894052 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ee588-4ae6-49b6-aa38-96a10c54a530 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:38.912704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-764ffe1d-92f8-4184-a7ea-899888e813e6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:38.913945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-764ffe1d-92f8-4184-a7ea-899888e813e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:39.012091 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 201/406] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:39.030831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:39.035459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ffe1d-92f8-4184-a7ea-899888e813e6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:39.049336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:39.094960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ee588-4ae6-49b6-aa38-96a10c54a530 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:39.177231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56de51-1c29-4142-9dbe-2e7ff7f30141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:39.178155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56de51-1c29-4142-9dbe-2e7ff7f30141 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:39.178439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56de51-1c29-4142-9dbe-2e7ff7f30141 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:39.178723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56de51-1c29-4142-9dbe-2e7ff7f30141 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:39.179629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56de51-1c29-4142-9dbe-2e7ff7f30141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:39.180252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56de51-1c29-4142-9dbe-2e7ff7f30141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:39.181963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56de51-1c29-4142-9dbe-2e7ff7f30141 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:39.196610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ffe1d-92f8-4184-a7ea-899888e813e6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:39.203043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 206/407] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:39.208687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56de51-1c29-4142-9dbe-2e7ff7f30141 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:39.267453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0f31f-c6ca-4d74-afd9-8c3518e9938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:39.267994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0f31f-c6ca-4d74-afd9-8c3518e9938d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:39.268272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0f31f-c6ca-4d74-afd9-8c3518e9938d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:39.268541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0f31f-c6ca-4d74-afd9-8c3518e9938d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:39.289384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0f31f-c6ca-4d74-afd9-8c3518e9938d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-88f0f31f-c6ca-4d74-afd9-8c3518e9938d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:39.297241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:39.298142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:39.299070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 202/408] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:39.307164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0f31f-c6ca-4d74-afd9-8c3518e9938d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:39.408201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56de51-1c29-4142-9dbe-2e7ff7f30141 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:39.440409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:39.454420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:39.457457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096198-3d8c-4ef7-8ec2-f1855dc3a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:39.458971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096198-3d8c-4ef7-8ec2-f1855dc3a89c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:39.459295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096198-3d8c-4ef7-8ec2-f1855dc3a89c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:39.459574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096198-3d8c-4ef7-8ec2-f1855dc3a89c None admin] PATH_INFO: `/v3/groups/bd828e8e825a49f0ac27416b9ec7b42a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:39.460895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76096198-3d8c-4ef7-8ec2-f1855dc3a89c None admin] RBAC: Authorizing `identity:get_group(group_id=bd828e8e825a49f0ac27416b9ec7b42a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:39.462443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76096198-3d8c-4ef7-8ec2-f1855dc3a89c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:39.465628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 207/409] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:39 2022] GET /identity/v3/groups/bd828e8e825a49f0ac27416b9ec7b42a => generated 229 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:39.466804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26636d-10b8-4be6-a8ca-5f3ed57a6dec None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:39.470171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26636d-10b8-4be6-a8ca-5f3ed57a6dec None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:39.470480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26636d-10b8-4be6-a8ca-5f3ed57a6dec None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:39.471912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 208/410] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:39.473507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26636d-10b8-4be6-a8ca-5f3ed57a6dec None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:39.505130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0f31f-c6ca-4d74-afd9-8c3518e9938d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:39.544869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5049a18-b5fd-41e6-bedc-ef305cf64152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:39.545406 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049a18-b5fd-41e6-bedc-ef305cf64152 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:39.545686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049a18-b5fd-41e6-bedc-ef305cf64152 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:39.545965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5049a18-b5fd-41e6-bedc-ef305cf64152 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:39.546946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5049a18-b5fd-41e6-bedc-ef305cf64152 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:39.547292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5049a18-b5fd-41e6-bedc-ef305cf64152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:39.548694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5049a18-b5fd-41e6-bedc-ef305cf64152 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:39.557682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 203/411] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:39.562215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25708557-fcde-4cb1-ae4d-6773459bb6e0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:39.562215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25708557-fcde-4cb1-ae4d-6773459bb6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:39.562215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25708557-fcde-4cb1-ae4d-6773459bb6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:39.581116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-25708557-fcde-4cb1-ae4d-6773459bb6e0 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:39.582414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-25708557-fcde-4cb1-ae4d-6773459bb6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:39.600517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26636d-10b8-4be6-a8ca-5f3ed57a6dec None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:39.643018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662afa75-3cd9-4bc2-89ad-52e7d865c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:39.644176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662afa75-3cd9-4bc2-89ad-52e7d865c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:39.644774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662afa75-3cd9-4bc2-89ad-52e7d865c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:39.645239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662afa75-3cd9-4bc2-89ad-52e7d865c0a5 None admin] PATH_INFO: `/v3/projects/998b35aeaf484d148461559c217775c3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:39.647413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662afa75-3cd9-4bc2-89ad-52e7d865c0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=998b35aeaf484d148461559c217775c3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:39.649578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662afa75-3cd9-4bc2-89ad-52e7d865c0a5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:39.652695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 209/412] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:39 2022] GET /identity/v3/projects/998b35aeaf484d148461559c217775c3 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:39.653718 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662afa75-3cd9-4bc2-89ad-52e7d865c0a5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:39.660698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 204/413] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:39.667231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25708557-fcde-4cb1-ae4d-6773459bb6e0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:39.747987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:39.754303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:39.797860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662afa75-3cd9-4bc2-89ad-52e7d865c0a5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:39.799559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25708557-fcde-4cb1-ae4d-6773459bb6e0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:39.838092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27061106-3de9-4c01-94cf-ca3c0ef2f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:39.839148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27061106-3de9-4c01-94cf-ca3c0ef2f981 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:39.839350 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab6a76-d406-4e83-9060-abb7d898e315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:39.839876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27061106-3de9-4c01-94cf-ca3c0ef2f981 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:39.839980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab6a76-d406-4e83-9060-abb7d898e315 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:39.840264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab6a76-d406-4e83-9060-abb7d898e315 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:39.840538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab6a76-d406-4e83-9060-abb7d898e315 None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:39.840838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27061106-3de9-4c01-94cf-ca3c0ef2f981 None admin] PATH_INFO: `/v3/projects/998b35aeaf484d148461559c217775c3/groups/bd828e8e825a49f0ac27416b9ec7b42a/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:39.841688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab6a76-d406-4e83-9060-abb7d898e315 None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:39.843265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27061106-3de9-4c01-94cf-ca3c0ef2f981 None admin] RBAC: Authorizing `identity:create_grant(project_id=998b35aeaf484d148461559c217775c3, group_id=bd828e8e825a49f0ac27416b9ec7b42a, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:39.843385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab6a76-d406-4e83-9060-abb7d898e315 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:39.845567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27061106-3de9-4c01-94cf-ca3c0ef2f981 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:39.850219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 210/414] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:39 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:39.851659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab6a76-d406-4e83-9060-abb7d898e315 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:39.867060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 205/415] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Aug 4 04:27:39 2022] PUT /identity/v3/projects/998b35aeaf484d148461559c217775c3/groups/bd828e8e825a49f0ac27416b9ec7b42a/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:39.868505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27061106-3de9-4c01-94cf-ca3c0ef2f981 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:40.055778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab6a76-d406-4e83-9060-abb7d898e315 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:40.072617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27061106-3de9-4c01-94cf-ca3c0ef2f981 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:40.093027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:40.100609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907557b-aa2e-4cf5-af7f-4098d420ed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:40.101258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907557b-aa2e-4cf5-af7f-4098d420ed8b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:40.101545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907557b-aa2e-4cf5-af7f-4098d420ed8b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:40.101821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907557b-aa2e-4cf5-af7f-4098d420ed8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:40.104387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:40.115602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907557b-aa2e-4cf5-af7f-4098d420ed8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-0907557b-aa2e-4cf5-af7f-4098d420ed8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:40.121368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:40.122433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:40.123442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:40.125913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 211/416] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:40.130626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e807ce-8291-47b2-9906-e6d870709ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:40.130626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e807ce-8291-47b2-9906-e6d870709ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:40.130970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e807ce-8291-47b2-9906-e6d870709ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:40.131484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e807ce-8291-47b2-9906-e6d870709ea8 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:40.131851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907557b-aa2e-4cf5-af7f-4098d420ed8b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:40.133175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e807ce-8291-47b2-9906-e6d870709ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:40.134854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e807ce-8291-47b2-9906-e6d870709ea8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:40.137230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 206/417] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:39 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:40.144178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e807ce-8291-47b2-9906-e6d870709ea8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:40.267834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e807ce-8291-47b2-9906-e6d870709ea8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:40.330971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd52f08-8f8a-4ee5-8dcc-859af320b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:40.331588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52f08-8f8a-4ee5-8dcc-859af320b997 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:40.331865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52f08-8f8a-4ee5-8dcc-859af320b997 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:40.332141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52f08-8f8a-4ee5-8dcc-859af320b997 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485/groups/e4133d2271684c42a87347f1fc44018f/roles/22759f25d96f4063a7d10f7048d7b3bd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:40.337745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd52f08-8f8a-4ee5-8dcc-859af320b997 None admin] RBAC: Authorizing `identity:create_grant(project_id=70bd38425cfc4d7aba3d67244f967485, group_id=e4133d2271684c42a87347f1fc44018f, role_id=22759f25d96f4063a7d10f7048d7b3bd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:40.339270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd52f08-8f8a-4ee5-8dcc-859af320b997 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:40.355955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 207/418] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Aug 4 04:27:40 2022] PUT /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485/groups/e4133d2271684c42a87347f1fc44018f/roles/22759f25d96f4063a7d10f7048d7b3bd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:27:40.367017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907557b-aa2e-4cf5-af7f-4098d420ed8b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:40.418679 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e665ef-e066-46d2-b58b-d2818bf0a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:40.419348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e665ef-e066-46d2-b58b-d2818bf0a661 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:40.419630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e665ef-e066-46d2-b58b-d2818bf0a661 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:40.419900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e665ef-e066-46d2-b58b-d2818bf0a661 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:40.420625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e665ef-e066-46d2-b58b-d2818bf0a661 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:40.420929 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e665ef-e066-46d2-b58b-d2818bf0a661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:40.422628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e665ef-e066-46d2-b58b-d2818bf0a661 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:40.438874 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 212/419] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:40.444810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd52f08-8f8a-4ee5-8dcc-859af320b997 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:40.505394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:40.520665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c6552-6098-4d35-b04a-ff018eff33b8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:40.521190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c6552-6098-4d35-b04a-ff018eff33b8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:40.521469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c6552-6098-4d35-b04a-ff018eff33b8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:40.523126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 213/420] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:40.529422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e476c-ff49-434b-b680-17f1f32be0e8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:40.529713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e476c-ff49-434b-b680-17f1f32be0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:40.529981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e476c-ff49-434b-b680-17f1f32be0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:40.559020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-288e476c-ff49-434b-b680-17f1f32be0e8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:40.559020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-288e476c-ff49-434b-b680-17f1f32be0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:40.575386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd52f08-8f8a-4ee5-8dcc-859af320b997 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:40.617864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0c9fd-312c-45bd-babc-535ccc6c5ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:40.618400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0c9fd-312c-45bd-babc-535ccc6c5ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:40.618678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0c9fd-312c-45bd-babc-535ccc6c5ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:40.618951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0c9fd-312c-45bd-babc-535ccc6c5ab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:40.639349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:40.662036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 214/421] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:40.694355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e476c-ff49-434b-b680-17f1f32be0e8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:40.721491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0c9fd-312c-45bd-babc-535ccc6c5ab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:40.722972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0c9fd-312c-45bd-babc-535ccc6c5ab7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:40.779257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:40.849699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 208/422] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:40.851086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0c9fd-312c-45bd-babc-535ccc6c5ab7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:40.967840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0c9fd-312c-45bd-babc-535ccc6c5ab7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:40.993172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e476c-ff49-434b-b680-17f1f32be0e8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:41.008989 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85109bc-f2f6-4c9e-911d-447fbf6ed2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:41.010238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85109bc-f2f6-4c9e-911d-447fbf6ed2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.010667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85109bc-f2f6-4c9e-911d-447fbf6ed2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.011452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85109bc-f2f6-4c9e-911d-447fbf6ed2d9 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.012798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85109bc-f2f6-4c9e-911d-447fbf6ed2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:41.014380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85109bc-f2f6-4c9e-911d-447fbf6ed2d9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:41.021672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 209/423] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:40 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:41.023624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85109bc-f2f6-4c9e-911d-447fbf6ed2d9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:41.047191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:41.065973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f37c3e-ec72-44a2-aaa1-e516bb941c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:41.067612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f37c3e-ec72-44a2-aaa1-e516bb941c5c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.068212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f37c3e-ec72-44a2-aaa1-e516bb941c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.069871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f37c3e-ec72-44a2-aaa1-e516bb941c5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.091354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f37c3e-ec72-44a2-aaa1-e516bb941c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d3f37c3e-ec72-44a2-aaa1-e516bb941c5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:41.101963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:41.103095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:41.104129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:41.107822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 215/424] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:41.115773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f37c3e-ec72-44a2-aaa1-e516bb941c5c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:41.168150 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:41.193837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85109bc-f2f6-4c9e-911d-447fbf6ed2d9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:41.228606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f37c3e-ec72-44a2-aaa1-e516bb941c5c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:41.237445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412303c-ca96-47aa-8466-61268e1fa5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:41.238493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412303c-ca96-47aa-8466-61268e1fa5eb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.239303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412303c-ca96-47aa-8466-61268e1fa5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.239873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412303c-ca96-47aa-8466-61268e1fa5eb None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.241138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412303c-ca96-47aa-8466-61268e1fa5eb None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:41.242693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412303c-ca96-47aa-8466-61268e1fa5eb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:41.248756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 210/425] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:41 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:41.248756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c342d-8cb9-49f2-afec-97a11d3250aa None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.248756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c342d-8cb9-49f2-afec-97a11d3250aa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.248756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c342d-8cb9-49f2-afec-97a11d3250aa None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.248756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 211/426] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:41.253104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c5724-290c-4c3f-8524-6f5226c926a3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.253394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c5724-290c-4c3f-8524-6f5226c926a3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.253669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c5724-290c-4c3f-8524-6f5226c926a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.272947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7b8c5724-290c-4c3f-8524-6f5226c926a3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:41.274183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7b8c5724-290c-4c3f-8524-6f5226c926a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:41.276137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf6303-a586-40fc-9daa-bdc0c2878ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:41.276920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf6303-a586-40fc-9daa-bdc0c2878ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.277342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf6303-a586-40fc-9daa-bdc0c2878ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.277781 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf6303-a586-40fc-9daa-bdc0c2878ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.278658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf6303-a586-40fc-9daa-bdc0c2878ce2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:41.279148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf6303-a586-40fc-9daa-bdc0c2878ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:41.280733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf6303-a586-40fc-9daa-bdc0c2878ce2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:41.294625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 216/427] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:41.295811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf6303-a586-40fc-9daa-bdc0c2878ce2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:41.353467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 212/428] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:41.354332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c5724-290c-4c3f-8524-6f5226c926a3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:41.386820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:41.407536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf6303-a586-40fc-9daa-bdc0c2878ce2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:41.415374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:41.445031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81da09a-82d5-4301-b6c2-c7779c979812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:41.445968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da09a-82d5-4301-b6c2-c7779c979812 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.446083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da09a-82d5-4301-b6c2-c7779c979812 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.446414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da09a-82d5-4301-b6c2-c7779c979812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.447364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81da09a-82d5-4301-b6c2-c7779c979812 None admin] RBAC: Adding query filter params (group.id=e4133d2271684c42a87347f1fc44018f, role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:41.447670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81da09a-82d5-4301-b6c2-c7779c979812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:41.449156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81da09a-82d5-4301-b6c2-c7779c979812 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:41.455325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 217/429] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:41 2022] GET /identity/v3/role_assignments?group.id=e4133d2271684c42a87347f1fc44018f&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:41.462093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81da09a-82d5-4301-b6c2-c7779c979812 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:41.495381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c5724-290c-4c3f-8524-6f5226c926a3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:41.564798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41eded-6dfe-4b50-b9c9-a9959b8289d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:41.565865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41eded-6dfe-4b50-b9c9-a9959b8289d6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.566498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41eded-6dfe-4b50-b9c9-a9959b8289d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.569107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41eded-6dfe-4b50-b9c9-a9959b8289d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.662393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81da09a-82d5-4301-b6c2-c7779c979812 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:41.702338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41eded-6dfe-4b50-b9c9-a9959b8289d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:41.704510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41eded-6dfe-4b50-b9c9-a9959b8289d6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:41.716453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d73d-92a9-4f22-a11c-83f590ccd292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:41.717115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d73d-92a9-4f22-a11c-83f590ccd292 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.717399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d73d-92a9-4f22-a11c-83f590ccd292 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.717675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d73d-92a9-4f22-a11c-83f590ccd292 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.724108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:41.736629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678d73d-92a9-4f22-a11c-83f590ccd292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-2678d73d-92a9-4f22-a11c-83f590ccd292 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:41.744776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:41.745951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 04:27:41.746898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:41.748680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 218/430] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:41.758549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d73d-92a9-4f22-a11c-83f590ccd292 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:41.799228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:41.871421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 213/431] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:41.874207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41eded-6dfe-4b50-b9c9-a9959b8289d6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:41.903806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d73d-92a9-4f22-a11c-83f590ccd292 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:41.950469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf1abe-2cf4-434f-923c-b6cbf897a435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:41.951664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf1abe-2cf4-434f-923c-b6cbf897a435 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:41.952150 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf1abe-2cf4-434f-923c-b6cbf897a435 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:41.952826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf1abe-2cf4-434f-923c-b6cbf897a435 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:41.954448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf1abe-2cf4-434f-923c-b6cbf897a435 None admin] RBAC: Adding query filter params (name=member) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:41.954959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf1abe-2cf4-434f-923c-b6cbf897a435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:41.956532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf1abe-2cf4-434f-923c-b6cbf897a435 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:41.968033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 219/432] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:27:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:41.973922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf1abe-2cf4-434f-923c-b6cbf897a435 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:42.004087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41eded-6dfe-4b50-b9c9-a9959b8289d6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:42.019786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:42.041450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a81e98-5f2d-4c09-9605-b60bd644d447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:42.042428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81e98-5f2d-4c09-9605-b60bd644d447 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.042428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81e98-5f2d-4c09-9605-b60bd644d447 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.042723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81e98-5f2d-4c09-9605-b60bd644d447 None admin] PATH_INFO: `/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.043919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a81e98-5f2d-4c09-9605-b60bd644d447 None admin] RBAC: Authorizing `identity:get_project(project_id=e63992ad2ad44ebd85dc7df2b2522b34)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:42.045454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a81e98-5f2d-4c09-9605-b60bd644d447 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:42.051872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 214/433] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:41 2022] GET /identity/v3/projects/e63992ad2ad44ebd85dc7df2b2522b34 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:42.055252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a81e98-5f2d-4c09-9605-b60bd644d447 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:42.104860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:42.117835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf1abe-2cf4-434f-923c-b6cbf897a435 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:42.167028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bf613-d46e-4aaa-bb88-c59ce5d68cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:42.167892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bf613-d46e-4aaa-bb88-c59ce5d68cee None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.168316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bf613-d46e-4aaa-bb88-c59ce5d68cee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.168751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bf613-d46e-4aaa-bb88-c59ce5d68cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.185692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a81e98-5f2d-4c09-9605-b60bd644d447 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:42.228531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c937f3-8b6c-4ff8-853a-8dc4ef780f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:42.229337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c937f3-8b6c-4ff8-853a-8dc4ef780f67 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.229693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c937f3-8b6c-4ff8-853a-8dc4ef780f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.230556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c937f3-8b6c-4ff8-853a-8dc4ef780f67 None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.231899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c937f3-8b6c-4ff8-853a-8dc4ef780f67 None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:42.233460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c937f3-8b6c-4ff8-853a-8dc4ef780f67 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:42.239763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 215/434] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:42 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:42.243960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c937f3-8b6c-4ff8-853a-8dc4ef780f67 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:42.271266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bf613-d46e-4aaa-bb88-c59ce5d68cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:42.275563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bf613-d46e-4aaa-bb88-c59ce5d68cee None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:42.305329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:42.369855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c937f3-8b6c-4ff8-853a-8dc4ef780f67 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:42.413620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:42.425556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 220/435] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:42.426540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83609b7-fd62-43cc-bb98-e2892fd89ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:42.427198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83609b7-fd62-43cc-bb98-e2892fd89ffb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.427481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83609b7-fd62-43cc-bb98-e2892fd89ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.427754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83609b7-fd62-43cc-bb98-e2892fd89ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.428557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83609b7-fd62-43cc-bb98-e2892fd89ffb None admin] RBAC: Adding query filter params (group.id=e4133d2271684c42a87347f1fc44018f, role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:42.428866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83609b7-fd62-43cc-bb98-e2892fd89ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:42.430570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83609b7-fd62-43cc-bb98-e2892fd89ffb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:42.431502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23f56b-5b70-4d6b-8b86-b11acf45c27d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.431785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23f56b-5b70-4d6b-8b86-b11acf45c27d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.432055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23f56b-5b70-4d6b-8b86-b11acf45c27d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.433471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 221/436] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:42.434029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23f56b-5b70-4d6b-8b86-b11acf45c27d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:42.455247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 216/437] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:42 2022] GET /identity/v3/role_assignments?group.id=e4133d2271684c42a87347f1fc44018f&scope.project.id=e63992ad2ad44ebd85dc7df2b2522b34&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:42.455247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68046f11-ad85-4fea-bb1b-ad22fc21207f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.455247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68046f11-ad85-4fea-bb1b-ad22fc21207f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.455247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68046f11-ad85-4fea-bb1b-ad22fc21207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.469960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-68046f11-ad85-4fea-bb1b-ad22fc21207f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:42.471213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-68046f11-ad85-4fea-bb1b-ad22fc21207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:42.574363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 217/438] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:42.596132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23f56b-5b70-4d6b-8b86-b11acf45c27d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:42.601097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68046f11-ad85-4fea-bb1b-ad22fc21207f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:42.634640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592fc02-8125-4534-a267-5c050cd1aab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:42.635314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592fc02-8125-4534-a267-5c050cd1aab9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.635581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592fc02-8125-4534-a267-5c050cd1aab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.635849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592fc02-8125-4534-a267-5c050cd1aab9 None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.637593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592fc02-8125-4534-a267-5c050cd1aab9 None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:42.639066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592fc02-8125-4534-a267-5c050cd1aab9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:42.640726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 222/439] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:42 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:42.647242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592fc02-8125-4534-a267-5c050cd1aab9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:42.654743 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:42.724466 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68046f11-ad85-4fea-bb1b-ad22fc21207f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:42.728288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:42.782359 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45708551-ab37-455b-a8bc-d6fd77351a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:42.782607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45708551-ab37-455b-a8bc-d6fd77351a1c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.782808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45708551-ab37-455b-a8bc-d6fd77351a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.783121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45708551-ab37-455b-a8bc-d6fd77351a1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.794737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592fc02-8125-4534-a267-5c050cd1aab9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:42.798617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45708551-ab37-455b-a8bc-d6fd77351a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-45708551-ab37-455b-a8bc-d6fd77351a1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:42.804536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:42.805462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:42.806387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 218/440] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:42.807291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf33f0-84c4-4df7-8b82-17b837c1d107 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.807387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf33f0-84c4-4df7-8b82-17b837c1d107 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.807631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf33f0-84c4-4df7-8b82-17b837c1d107 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.809051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 219/441] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:42.815097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf33f0-84c4-4df7-8b82-17b837c1d107 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:42.843108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68546bc9-51b0-428d-aeb2-e3a5deb7ad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:42.843691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68546bc9-51b0-428d-aeb2-e3a5deb7ad71 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.843969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68546bc9-51b0-428d-aeb2-e3a5deb7ad71 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.844238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68546bc9-51b0-428d-aeb2-e3a5deb7ad71 None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.845377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68546bc9-51b0-428d-aeb2-e3a5deb7ad71 None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:42.846794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68546bc9-51b0-428d-aeb2-e3a5deb7ad71 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:42.848531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 223/442] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:42 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:42.850670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8a9d8-4414-4de5-922c-9d4535fb56a1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.850947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8a9d8-4414-4de5-922c-9d4535fb56a1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.851253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8a9d8-4414-4de5-922c-9d4535fb56a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.871792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d7a8a9d8-4414-4de5-922c-9d4535fb56a1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:42.872960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d7a8a9d8-4414-4de5-922c-9d4535fb56a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:42.927759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf33f0-84c4-4df7-8b82-17b837c1d107 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:42.930261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:42.942240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 224/443] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:42.944221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8a9d8-4414-4de5-922c-9d4535fb56a1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:42.965644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997154c-2e85-43fd-b255-532c92a753e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:42.966036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997154c-2e85-43fd-b255-532c92a753e5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:42.966310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997154c-2e85-43fd-b255-532c92a753e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:42.966575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997154c-2e85-43fd-b255-532c92a753e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:42.967319 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997154c-2e85-43fd-b255-532c92a753e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:42.967622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997154c-2e85-43fd-b255-532c92a753e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:42.968971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997154c-2e85-43fd-b255-532c92a753e5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:42.977032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 220/444] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:42.977715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997154c-2e85-43fd-b255-532c92a753e5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:43.006348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:43.046688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8a9d8-4414-4de5-922c-9d4535fb56a1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.080437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997154c-2e85-43fd-b255-532c92a753e5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.080867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb1f89-38ae-425a-a69a-c8c8f5a2c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.081488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb1f89-38ae-425a-a69a-c8c8f5a2c0fe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.081771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb1f89-38ae-425a-a69a-c8c8f5a2c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.082045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb1f89-38ae-425a-a69a-c8c8f5a2c0fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.082837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb1f89-38ae-425a-a69a-c8c8f5a2c0fe None admin] RBAC: Adding query filter params (group.id=e4133d2271684c42a87347f1fc44018f, role.id=a8a24aac5beb466aa9599c299ab9ec1a, scope.project.id=70bd38425cfc4d7aba3d67244f967485) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:43.083174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb1f89-38ae-425a-a69a-c8c8f5a2c0fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:43.084606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb1f89-38ae-425a-a69a-c8c8f5a2c0fe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:43.090614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 225/445] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:42 2022] GET /identity/v3/role_assignments?group.id=e4133d2271684c42a87347f1fc44018f&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=a8a24aac5beb466aa9599c299ab9ec1a => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:43.092254 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb1f89-38ae-425a-a69a-c8c8f5a2c0fe None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:43.137644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907a3dd-d2db-4e5f-86d6-9827bddfd59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.138561 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a3dd-d2db-4e5f-86d6-9827bddfd59d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.139022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a3dd-d2db-4e5f-86d6-9827bddfd59d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.139546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a3dd-d2db-4e5f-86d6-9827bddfd59d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.154592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907a3dd-d2db-4e5f-86d6-9827bddfd59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-1907a3dd-d2db-4e5f-86d6-9827bddfd59d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:43.160698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:43.161673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:43.162482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 221/446] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:43.167888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907a3dd-d2db-4e5f-86d6-9827bddfd59d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:43.200929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:43.227017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb1f89-38ae-425a-a69a-c8c8f5a2c0fe None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.256842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:43.272707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896ee27-9367-4889-9a83-c2fb5597c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.273332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896ee27-9367-4889-9a83-c2fb5597c060 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.273607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896ee27-9367-4889-9a83-c2fb5597c060 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.273876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896ee27-9367-4889-9a83-c2fb5597c060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.287639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907a3dd-d2db-4e5f-86d6-9827bddfd59d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.334310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99e31-bb49-4602-9de1-0566154e1448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.334310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99e31-bb49-4602-9de1-0566154e1448 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.334571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99e31-bb49-4602-9de1-0566154e1448 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.334878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99e31-bb49-4602-9de1-0566154e1448 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.336008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99e31-bb49-4602-9de1-0566154e1448 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:43.336111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99e31-bb49-4602-9de1-0566154e1448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:43.337619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99e31-bb49-4602-9de1-0566154e1448 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:43.348973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 222/447] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:43.354483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99e31-bb49-4602-9de1-0566154e1448 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:43.359805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896ee27-9367-4889-9a83-c2fb5597c060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:43.361321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896ee27-9367-4889-9a83-c2fb5597c060 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:43.467974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:43.478239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 226/448] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:43.483900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896ee27-9367-4889-9a83-c2fb5597c060 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:43.486370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99e31-bb49-4602-9de1-0566154e1448 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.506690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:43.519704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b7310-4351-4c65-b10b-f090dd02de37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.520308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b7310-4351-4c65-b10b-f090dd02de37 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.520583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b7310-4351-4c65-b10b-f090dd02de37 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.520852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b7310-4351-4c65-b10b-f090dd02de37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.583875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896ee27-9367-4889-9a83-c2fb5597c060 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.591871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b7310-4351-4c65-b10b-f090dd02de37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:43.593324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b7310-4351-4c65-b10b-f090dd02de37 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:43.620395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474887f2-6334-4d8d-92e4-116b90af3747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.621030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474887f2-6334-4d8d-92e4-116b90af3747 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.621303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474887f2-6334-4d8d-92e4-116b90af3747 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.621575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474887f2-6334-4d8d-92e4-116b90af3747 None admin] PATH_INFO: `/v3/projects/998b35aeaf484d148461559c217775c3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.622717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474887f2-6334-4d8d-92e4-116b90af3747 None admin] RBAC: Authorizing `identity:get_project(project_id=998b35aeaf484d148461559c217775c3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:43.624162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474887f2-6334-4d8d-92e4-116b90af3747 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:43.625856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 227/449] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:43 2022] GET /identity/v3/projects/998b35aeaf484d148461559c217775c3 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:43.631306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474887f2-6334-4d8d-92e4-116b90af3747 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:43.680697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:43.693128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 223/450] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 04:27:43.698619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b7310-4351-4c65-b10b-f090dd02de37 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:43.721827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:43.732608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474887f2-6334-4d8d-92e4-116b90af3747 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.767508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cdc2b-818b-465b-8828-8512aee400ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.768164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cdc2b-818b-465b-8828-8512aee400ee None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.768447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cdc2b-818b-465b-8828-8512aee400ee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.768715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cdc2b-818b-465b-8828-8512aee400ee None admin] PATH_INFO: `/v3/groups/bd828e8e825a49f0ac27416b9ec7b42a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.769882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cdc2b-818b-465b-8828-8512aee400ee None admin] RBAC: Authorizing `identity:get_group(group_id=bd828e8e825a49f0ac27416b9ec7b42a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:43.771336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cdc2b-818b-465b-8828-8512aee400ee None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:43.772914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 228/451] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:43 2022] GET /identity/v3/groups/bd828e8e825a49f0ac27416b9ec7b42a => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:43.778592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cdc2b-818b-465b-8828-8512aee400ee None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:43.798605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b7310-4351-4c65-b10b-f090dd02de37 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.832585 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db77bed-1e6d-488f-8ba3-e2e0817540ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.833211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db77bed-1e6d-488f-8ba3-e2e0817540ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.833489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db77bed-1e6d-488f-8ba3-e2e0817540ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.833761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db77bed-1e6d-488f-8ba3-e2e0817540ed None admin] PATH_INFO: `/v3/projects/70bd38425cfc4d7aba3d67244f967485` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.834908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db77bed-1e6d-488f-8ba3-e2e0817540ed None admin] RBAC: Authorizing `identity:get_project(project_id=70bd38425cfc4d7aba3d67244f967485)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:43.836382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db77bed-1e6d-488f-8ba3-e2e0817540ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:43.837998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 224/452] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:27:43 2022] GET /identity/v3/projects/70bd38425cfc4d7aba3d67244f967485 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:43.843637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db77bed-1e6d-488f-8ba3-e2e0817540ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:43.877272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cdc2b-818b-465b-8828-8512aee400ee None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.899008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:43.910926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee788be3-15ed-42c6-8fa9-f700e82d63c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.911630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee788be3-15ed-42c6-8fa9-f700e82d63c5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.911972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee788be3-15ed-42c6-8fa9-f700e82d63c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.912305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee788be3-15ed-42c6-8fa9-f700e82d63c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.913154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee788be3-15ed-42c6-8fa9-f700e82d63c5 None admin] RBAC: Adding query filter params (group.id=bd828e8e825a49f0ac27416b9ec7b42a, role.id=c1429555635349208e8b2bd908436746, scope.project.id=998b35aeaf484d148461559c217775c3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:43.913526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee788be3-15ed-42c6-8fa9-f700e82d63c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:43.914931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee788be3-15ed-42c6-8fa9-f700e82d63c5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:43.920582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 229/453] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:43 2022] GET /identity/v3/role_assignments?group.id=bd828e8e825a49f0ac27416b9ec7b42a&scope.project.id=998b35aeaf484d148461559c217775c3&role.id=c1429555635349208e8b2bd908436746 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:43.943348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db77bed-1e6d-488f-8ba3-e2e0817540ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:43.980111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52d37a-0b2d-4af8-a409-f2d50622e0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:43.980667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d37a-0b2d-4af8-a409-f2d50622e0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:43.980946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d37a-0b2d-4af8-a409-f2d50622e0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:43.981214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52d37a-0b2d-4af8-a409-f2d50622e0f2 None admin] PATH_INFO: `/v3/groups/e4133d2271684c42a87347f1fc44018f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:43.982393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52d37a-0b2d-4af8-a409-f2d50622e0f2 None admin] RBAC: Authorizing `identity:get_group(group_id=e4133d2271684c42a87347f1fc44018f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:43.983917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52d37a-0b2d-4af8-a409-f2d50622e0f2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:43.985629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 225/454] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Aug 4 04:27:43 2022] GET /identity/v3/groups/e4133d2271684c42a87347f1fc44018f => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:43.992172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee788be3-15ed-42c6-8fa9-f700e82d63c5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:44.019541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:44.097980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee788be3-15ed-42c6-8fa9-f700e82d63c5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:44.130841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dd252-8ef2-4a06-b588-8bcb83ae8872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:44.131481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dd252-8ef2-4a06-b588-8bcb83ae8872 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:44.131758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dd252-8ef2-4a06-b588-8bcb83ae8872 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:44.132028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dd252-8ef2-4a06-b588-8bcb83ae8872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:44.132803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dd252-8ef2-4a06-b588-8bcb83ae8872 None admin] RBAC: Adding query filter params (group.id=e4133d2271684c42a87347f1fc44018f, role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=70bd38425cfc4d7aba3d67244f967485) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:44.133107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dd252-8ef2-4a06-b588-8bcb83ae8872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:44.134524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dd252-8ef2-4a06-b588-8bcb83ae8872 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:44.140105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 230/455] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Aug 4 04:27:43 2022] GET /identity/v3/role_assignments?group.id=e4133d2271684c42a87347f1fc44018f&scope.project.id=70bd38425cfc4d7aba3d67244f967485&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:46.660469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517365d-67c4-4151-9180-77172087ddc9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:46.660986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517365d-67c4-4151-9180-77172087ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:46.660986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517365d-67c4-4151-9180-77172087ddc9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:46.662348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 226/456] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:46.667632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418b059-83b4-45ef-a81d-c8f4fa3f3faf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:46.668053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418b059-83b4-45ef-a81d-c8f4fa3f3faf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:46.668259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418b059-83b4-45ef-a81d-c8f4fa3f3faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:46.695983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8418b059-83b4-45ef-a81d-c8f4fa3f3faf None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:46.697196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8418b059-83b4-45ef-a81d-c8f4fa3f3faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:46.775840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46e91-c9eb-417a-a4b6-23ba718b1888 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:46.776118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46e91-c9eb-417a-a4b6-23ba718b1888 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:46.776549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46e91-c9eb-417a-a4b6-23ba718b1888 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:46.778875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 227/457] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:46.784529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5c27-5aa9-459f-ba07-da7c595ab454 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:46.785063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5c27-5aa9-459f-ba07-da7c595ab454 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:46.785554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5c27-5aa9-459f-ba07-da7c595ab454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:46.808409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 231/458] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:46.819007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ee3c5c27-5aa9-459f-ba07-da7c595ab454 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:46.819007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ee3c5c27-5aa9-459f-ba07-da7c595ab454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:46.833208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418b059-83b4-45ef-a81d-c8f4fa3f3faf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:46.853182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:46.948417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 228/459] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:46.965205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418b059-83b4-45ef-a81d-c8f4fa3f3faf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:46.995499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5c27-5aa9-459f-ba07-da7c595ab454 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:47.009996 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48215142-61d5-44b7-ad59-d100f2d294f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:47.010649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48215142-61d5-44b7-ad59-d100f2d294f4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.010926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48215142-61d5-44b7-ad59-d100f2d294f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.011220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48215142-61d5-44b7-ad59-d100f2d294f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.031103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48215142-61d5-44b7-ad59-d100f2d294f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:47.033085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48215142-61d5-44b7-ad59-d100f2d294f4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-48215142-61d5-44b7-ad59-d100f2d294f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:47.070197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:47.071171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:47.072283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:47.072283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:47.072283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:47.072283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:47.072283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 232/460] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:47.078048 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48215142-61d5-44b7-ad59-d100f2d294f4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:47.091173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:47.140362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5c27-5aa9-459f-ba07-da7c595ab454 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:47.152261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:47.179801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07ed24-020f-4076-9615-40070ec90622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:47.180841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07ed24-020f-4076-9615-40070ec90622 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.181293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07ed24-020f-4076-9615-40070ec90622 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.181762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07ed24-020f-4076-9615-40070ec90622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.189997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48215142-61d5-44b7-ad59-d100f2d294f4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:47.193225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07ed24-020f-4076-9615-40070ec90622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:47.194889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07ed24-020f-4076-9615-40070ec90622 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7f07ed24-020f-4076-9615-40070ec90622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:47.211757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:47.212624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:47.213439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:47.213439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:47.213439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:47.213439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:47.215776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 229/461] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:47.217289 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec277f-67a9-4809-a134-31d0d8f46722 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.217779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec277f-67a9-4809-a134-31d0d8f46722 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.218234 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec277f-67a9-4809-a134-31d0d8f46722 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.221940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 230/462] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:47.222861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec277f-67a9-4809-a134-31d0d8f46722 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:47.232139 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f89107-79a7-42d8-a316-3e3a577a7f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:47.232770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89107-79a7-42d8-a316-3e3a577a7f14 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.233052 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89107-79a7-42d8-a316-3e3a577a7f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.233327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89107-79a7-42d8-a316-3e3a577a7f14 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.234403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89107-79a7-42d8-a316-3e3a577a7f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:47.234403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89107-79a7-42d8-a316-3e3a577a7f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:47.236261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89107-79a7-42d8-a316-3e3a577a7f14 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:47.249434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 233/463] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:47.250616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a66fb4-ecea-42a1-808c-47a9b69cecb6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.250896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a66fb4-ecea-42a1-808c-47a9b69cecb6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.251197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a66fb4-ecea-42a1-808c-47a9b69cecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.269406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-48a66fb4-ecea-42a1-808c-47a9b69cecb6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:47.270608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-48a66fb4-ecea-42a1-808c-47a9b69cecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:47.340522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec277f-67a9-4809-a134-31d0d8f46722 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:47.344081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 234/464] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:47.345312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a66fb4-ecea-42a1-808c-47a9b69cecb6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:47.349789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:47.389744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836092f4-a1c1-4543-ba0a-83f2d98e7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:47.390370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836092f4-a1c1-4543-ba0a-83f2d98e7264 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.390647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836092f4-a1c1-4543-ba0a-83f2d98e7264 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.390916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836092f4-a1c1-4543-ba0a-83f2d98e7264 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.392318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836092f4-a1c1-4543-ba0a-83f2d98e7264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:47.393770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836092f4-a1c1-4543-ba0a-83f2d98e7264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:47.395298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836092f4-a1c1-4543-ba0a-83f2d98e7264 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:47.414271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 231/465] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:47.415220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836092f4-a1c1-4543-ba0a-83f2d98e7264 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:47.434647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:47.479396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a66fb4-ecea-42a1-808c-47a9b69cecb6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:47.517661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d7aa6-92d3-4895-b159-f8573d723973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:47.518653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d7aa6-92d3-4895-b159-f8573d723973 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.519162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d7aa6-92d3-4895-b159-f8573d723973 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.519641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d7aa6-92d3-4895-b159-f8573d723973 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.520505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d7aa6-92d3-4895-b159-f8573d723973 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:47.522119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d7aa6-92d3-4895-b159-f8573d723973 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:47.524898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836092f4-a1c1-4543-ba0a-83f2d98e7264 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:47.547176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 235/466] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:47 2022] POST /identity/v3/users => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:47.548380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d7aa6-92d3-4895-b159-f8573d723973 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:47.568504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0d479-4727-49db-8a2b-94ae716aa6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:47.569624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0d479-4727-49db-8a2b-94ae716aa6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.569901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0d479-4727-49db-8a2b-94ae716aa6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.570172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0d479-4727-49db-8a2b-94ae716aa6d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.583293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0d479-4727-49db-8a2b-94ae716aa6d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:47.585285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0d479-4727-49db-8a2b-94ae716aa6d0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-23f0d479-4727-49db-8a2b-94ae716aa6d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:47.602723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:47.603752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:47.604816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:47.604816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:47.604816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:47.604816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:47.604816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 232/467] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:47.610917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c015e1c-0376-4e77-9f63-2bd5b6741581 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.610917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c015e1c-0376-4e77-9f63-2bd5b6741581 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.610917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c015e1c-0376-4e77-9f63-2bd5b6741581 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.613367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 233/468] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:47.614321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c015e1c-0376-4e77-9f63-2bd5b6741581 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:47.645056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:47.694819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d7aa6-92d3-4895-b159-f8573d723973 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:47.719946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:47.741372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7b980-7e05-4f87-9fcc-55f7b0d5bf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:47.741921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b980-7e05-4f87-9fcc-55f7b0d5bf4b None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.742197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b980-7e05-4f87-9fcc-55f7b0d5bf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.742635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b980-7e05-4f87-9fcc-55f7b0d5bf4b None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.744497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b980-7e05-4f87-9fcc-55f7b0d5bf4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:47.744624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b980-7e05-4f87-9fcc-55f7b0d5bf4b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:47.753870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c015e1c-0376-4e77-9f63-2bd5b6741581 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:47.775861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 236/469] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:47 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:47.777416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8c44-542d-493c-ae51-78790e5e0e2f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.777766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8c44-542d-493c-ae51-78790e5e0e2f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.778106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8c44-542d-493c-ae51-78790e5e0e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.798033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ebcb8c44-542d-493c-ae51-78790e5e0e2f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:47.798604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6cfd5-f9ba-4465-8eba-1e32621281dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:47.799493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6cfd5-f9ba-4465-8eba-1e32621281dd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.799625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ebcb8c44-542d-493c-ae51-78790e5e0e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:47.800073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6cfd5-f9ba-4465-8eba-1e32621281dd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.800518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6cfd5-f9ba-4465-8eba-1e32621281dd None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.801472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6cfd5-f9ba-4465-8eba-1e32621281dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:47.801957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6cfd5-f9ba-4465-8eba-1e32621281dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:47.803629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6cfd5-f9ba-4465-8eba-1e32621281dd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:47.817854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 234/470] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:47.823830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6cfd5-f9ba-4465-8eba-1e32621281dd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:47.880212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 237/471] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:47.908286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8c44-542d-493c-ae51-78790e5e0e2f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:47.919936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:47.946753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6cfd5-f9ba-4465-8eba-1e32621281dd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:47.987014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10d23-a9f0-4113-8ba0-f28861341a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:47.987652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10d23-a9f0-4113-8ba0-f28861341a4b None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:47.987974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10d23-a9f0-4113-8ba0-f28861341a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:47.988207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10d23-a9f0-4113-8ba0-f28861341a4b None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:47.988941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b10d23-a9f0-4113-8ba0-f28861341a4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:47.990330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b10d23-a9f0-4113-8ba0-f28861341a4b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:48.018816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 235/472] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:47 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:27:48.028377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:48.033287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8c44-542d-493c-ae51-78790e5e0e2f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:48.078915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72072caf-458c-4603-b25d-6dd6189f567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:48.079704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72072caf-458c-4603-b25d-6dd6189f567f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:48.079999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72072caf-458c-4603-b25d-6dd6189f567f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:48.080269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72072caf-458c-4603-b25d-6dd6189f567f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:48.093301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72072caf-458c-4603-b25d-6dd6189f567f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:48.095398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72072caf-458c-4603-b25d-6dd6189f567f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-72072caf-458c-4603-b25d-6dd6189f567f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:48.113704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:48.114594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:48.115491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:48.115491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:48.115491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:48.115491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:48.115491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 238/473] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:48.120991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10d23-a9f0-4113-8ba0-f28861341a4b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:48.250063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10d23-a9f0-4113-8ba0-f28861341a4b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:48.286516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9d355-3d97-4aae-a3c0-1ed5d854aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:48.287087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9d355-3d97-4aae-a3c0-1ed5d854aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:48.287374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9d355-3d97-4aae-a3c0-1ed5d854aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:48.287650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9d355-3d97-4aae-a3c0-1ed5d854aaa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:48.288412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9d355-3d97-4aae-a3c0-1ed5d854aaa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:48.288716 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9d355-3d97-4aae-a3c0-1ed5d854aaa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:48.290153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9d355-3d97-4aae-a3c0-1ed5d854aaa7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:48.291690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:48.304051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 236/474] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:48.309283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72072caf-458c-4603-b25d-6dd6189f567f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:48.370713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5def-754c-4812-805c-bc28e1b57737 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:48.371346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5def-754c-4812-805c-bc28e1b57737 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:48.371822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a5def-754c-4812-805c-bc28e1b57737 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:48.373772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 237/475] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:48.382727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd1298-146e-4154-9ddc-9d4fc72f7f6a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:48.383081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd1298-146e-4154-9ddc-9d4fc72f7f6a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:48.383358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd1298-146e-4154-9ddc-9d4fc72f7f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:48.403738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-77cd1298-146e-4154-9ddc-9d4fc72f7f6a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:48.404898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-77cd1298-146e-4154-9ddc-9d4fc72f7f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:48.428258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72072caf-458c-4603-b25d-6dd6189f567f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:48.465258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73edbb-02f5-42c8-8a4e-e6085438c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:48.466265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73edbb-02f5-42c8-8a4e-e6085438c19c None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:48.466759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73edbb-02f5-42c8-8a4e-e6085438c19c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:48.467263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73edbb-02f5-42c8-8a4e-e6085438c19c None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:48.468155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73edbb-02f5-42c8-8a4e-e6085438c19c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:48.469912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73edbb-02f5-42c8-8a4e-e6085438c19c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:48.474901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 238/476] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:48.493998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 239/477] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:48 2022] POST /identity/v3/users => generated 249 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:48.514464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd1298-146e-4154-9ddc-9d4fc72f7f6a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:48.651798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd1298-146e-4154-9ddc-9d4fc72f7f6a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:48.692331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:48.705894 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:48.706907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:48.707402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:48.707886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:48.708834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:48.710521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:48.725742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.sql.core [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 04:27:48.725742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 04:27:48.725742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [parameters: {'id': '99554b5d884f4ae78ceb0e7b239893e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 04:27:48.725742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Aug 04 04:27:48.742744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:27:48.743758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application yield resource Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise self.value Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application session.commit() Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 04:27:48.744640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.flush() Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application compat.raise_( Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 04:27:48.745491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:27:48.746345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:27:48.747168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [parameters: {'id': '99554b5d884f4ae78ceb0e7b239893e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:48.747936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 04:27:48.748708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:48.753696 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 239/478] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Aug 4 04:27:48 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:48.759356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73edbb-02f5-42c8-8a4e-e6085438c19c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:48.774124 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:48.887288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73edbb-02f5-42c8-8a4e-e6085438c19c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:48.924548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f5710-7d6d-4fd2-a7bf-6f28d924406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:48.925512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f5710-7d6d-4fd2-a7bf-6f28d924406d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:48.925989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f5710-7d6d-4fd2-a7bf-6f28d924406d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:48.926477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f5710-7d6d-4fd2-a7bf-6f28d924406d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:48.937266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f5710-7d6d-4fd2-a7bf-6f28d924406d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-126f5710-7d6d-4fd2-a7bf-6f28d924406d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:48.943329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:48.944224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 04:27:48.945001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:48.947304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 240/479] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:27:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:48.953031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:49.066508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f77235-5e35-47bd-ac1d-be1d91e80747 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:49.120844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca98b33-fe3d-4610-af96-b150581355e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:49.121829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98b33-fe3d-4610-af96-b150581355e8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:49.122331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98b33-fe3d-4610-af96-b150581355e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:49.122816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98b33-fe3d-4610-af96-b150581355e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:49.123774 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca98b33-fe3d-4610-af96-b150581355e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:49.124272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca98b33-fe3d-4610-af96-b150581355e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:49.125836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca98b33-fe3d-4610-af96-b150581355e8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:49.134776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 240/480] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:50.057648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013997aa-083f-47bb-b2ce-ff58789c8c01 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.058636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013997aa-083f-47bb-b2ce-ff58789c8c01 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.059148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013997aa-083f-47bb-b2ce-ff58789c8c01 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.060963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 241/481] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:50.066485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ab6db-e89a-4b10-b035-dfa566bf27a9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.067403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ab6db-e89a-4b10-b035-dfa566bf27a9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.067923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ab6db-e89a-4b10-b035-dfa566bf27a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.091493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4b0ab6db-e89a-4b10-b035-dfa566bf27a9 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:50.093116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4b0ab6db-e89a-4b10-b035-dfa566bf27a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:50.151982 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:50.185265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 241/482] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:50.221272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013997aa-083f-47bb-b2ce-ff58789c8c01 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:50.304047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:50.315213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cd294-d814-4a23-947c-edff7fa25bca None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.315483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cd294-d814-4a23-947c-edff7fa25bca None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.315689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cd294-d814-4a23-947c-edff7fa25bca None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.317298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 242/483] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:50.322043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4168e1c-2e8b-4973-a2c2-1b908149a742 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.322327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4168e1c-2e8b-4973-a2c2-1b908149a742 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.322603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4168e1c-2e8b-4973-a2c2-1b908149a742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.348974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c4168e1c-2e8b-4973-a2c2-1b908149a742 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:50.351669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c4168e1c-2e8b-4973-a2c2-1b908149a742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:50.383392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013997aa-083f-47bb-b2ce-ff58789c8c01 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:50.439814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e40e2-0337-4801-bc10-40e6bb6a2d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:50.440519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e40e2-0337-4801-bc10-40e6bb6a2d2a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.441700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e40e2-0337-4801-bc10-40e6bb6a2d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.441981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e40e2-0337-4801-bc10-40e6bb6a2d2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.465763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e40e2-0337-4801-bc10-40e6bb6a2d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b60e40e2-0337-4801-bc10-40e6bb6a2d2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:50.474693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:50.475667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:50.476450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:50.478700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 242/484] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:50.483257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e40e2-0337-4801-bc10-40e6bb6a2d2a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:50.498600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 243/485] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:50.521799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4168e1c-2e8b-4973-a2c2-1b908149a742 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:50.648275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e40e2-0337-4801-bc10-40e6bb6a2d2a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:50.671191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4168e1c-2e8b-4973-a2c2-1b908149a742 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:50.683231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:50.698552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:50.710797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff2677-c89d-453f-a284-ef525b5e1d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:50.711664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff2677-c89d-453f-a284-ef525b5e1d39 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.712115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff2677-c89d-453f-a284-ef525b5e1d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.712537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff2677-c89d-453f-a284-ef525b5e1d39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.716366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffa426-07ba-4af0-9b12-88ce3dbb45d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:50.716997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffa426-07ba-4af0-9b12-88ce3dbb45d7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.717277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffa426-07ba-4af0-9b12-88ce3dbb45d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.717551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffa426-07ba-4af0-9b12-88ce3dbb45d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.718276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffa426-07ba-4af0-9b12-88ce3dbb45d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:50.718783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffa426-07ba-4af0-9b12-88ce3dbb45d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:50.720250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffa426-07ba-4af0-9b12-88ce3dbb45d7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:50.723471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff2677-c89d-453f-a284-ef525b5e1d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8fff2677-c89d-453f-a284-ef525b5e1d39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:50.728591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:50.729464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:50.730261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 244/486] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:27:50.732398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 243/487] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:27:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:50.736246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffa426-07ba-4af0-9b12-88ce3dbb45d7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:50.741797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37922-4ff3-4554-957d-8f069d1f2ce5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.742080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37922-4ff3-4554-957d-8f069d1f2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.742358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37922-4ff3-4554-957d-8f069d1f2ce5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.746121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 245/488] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:50 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:50.747454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc37922-4ff3-4554-957d-8f069d1f2ce5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:50.857726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffa426-07ba-4af0-9b12-88ce3dbb45d7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:50.866908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc37922-4ff3-4554-957d-8f069d1f2ce5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:50.893179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350943d-4818-43dd-b4de-fba87e01c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:50.893799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350943d-4818-43dd-b4de-fba87e01c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.894078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350943d-4818-43dd-b4de-fba87e01c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.894352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350943d-4818-43dd-b4de-fba87e01c3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.895268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350943d-4818-43dd-b4de-fba87e01c3e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:50.895485 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350943d-4818-43dd-b4de-fba87e01c3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:50.897013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350943d-4818-43dd-b4de-fba87e01c3e0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:50.905882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 244/489] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:27:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:50.909341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b3b72-dfba-48e4-b923-116992f862fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:50.910285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b3b72-dfba-48e4-b923-116992f862fb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.910810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b3b72-dfba-48e4-b923-116992f862fb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.911317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b3b72-dfba-48e4-b923-116992f862fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.911681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2b035-560b-44e9-a89a-6746237b083b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:50.911989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2b035-560b-44e9-a89a-6746237b083b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:50.912269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2b035-560b-44e9-a89a-6746237b083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:50.924813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b3b72-dfba-48e4-b923-116992f862fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:50.926758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b3b72-dfba-48e4-b923-116992f862fb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:50.931572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-55b2b035-560b-44e9-a89a-6746237b083b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:50.932813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-55b2b035-560b-44e9-a89a-6746237b083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f95b3b72-dfba-48e4-b923-116992f862fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:50.943627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:50.944467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:50.945304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:50.945304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:50.945304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:50.945304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:50.947766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 246/490] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:50.948915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b3b72-dfba-48e4-b923-116992f862fb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:50.977608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:50.986910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:51.011779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 245/491] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:51.012684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2b035-560b-44e9-a89a-6746237b083b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.068553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b3b72-dfba-48e4-b923-116992f862fb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.115657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f3f31-18b0-49de-bbc0-469dee2a1836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:51.116345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f3f31-18b0-49de-bbc0-469dee2a1836 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.116633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f3f31-18b0-49de-bbc0-469dee2a1836 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.117158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f3f31-18b0-49de-bbc0-469dee2a1836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.132219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f3f31-18b0-49de-bbc0-469dee2a1836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:51.133934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f3f31-18b0-49de-bbc0-469dee2a1836 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:51.137487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2b035-560b-44e9-a89a-6746237b083b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c55f3f31-18b0-49de-bbc0-469dee2a1836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:51.153228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:51.154123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:51.154949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:51.154949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:51.154949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:51.154949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:51.154949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 247/492] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:51.155676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f3f31-18b0-49de-bbc0-469dee2a1836 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.189797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d543a-8e76-4474-8b82-e7310443ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:51.190437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d543a-8e76-4474-8b82-e7310443ec3d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.190716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d543a-8e76-4474-8b82-e7310443ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.191009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d543a-8e76-4474-8b82-e7310443ec3d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.192027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d543a-8e76-4474-8b82-e7310443ec3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:51.192332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d543a-8e76-4474-8b82-e7310443ec3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:51.194449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d543a-8e76-4474-8b82-e7310443ec3d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:51.209795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 246/493] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:51.210647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d543a-8e76-4474-8b82-e7310443ec3d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.248252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:51.267551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:51.275500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f3f31-18b0-49de-bbc0-469dee2a1836 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.311321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ec85a-87e1-4b61-8aaa-8af90c626bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:51.311968 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec85a-87e1-4b61-8aaa-8af90c626bbe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.312248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec85a-87e1-4b61-8aaa-8af90c626bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.312520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec85a-87e1-4b61-8aaa-8af90c626bbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.323004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ec85a-87e1-4b61-8aaa-8af90c626bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-292ec85a-87e1-4b61-8aaa-8af90c626bbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:51.328374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:51.330053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:51.330855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 248/494] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:51.331551 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ec85a-87e1-4b61-8aaa-8af90c626bbe None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.337938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d543a-8e76-4474-8b82-e7310443ec3d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.376387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444b0c0-ac00-473e-91a2-5d5bf84d8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:51.377277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444b0c0-ac00-473e-91a2-5d5bf84d8eec None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.377704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444b0c0-ac00-473e-91a2-5d5bf84d8eec None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.378472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444b0c0-ac00-473e-91a2-5d5bf84d8eec None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.379647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444b0c0-ac00-473e-91a2-5d5bf84d8eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:51.380104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444b0c0-ac00-473e-91a2-5d5bf84d8eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:51.382035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444b0c0-ac00-473e-91a2-5d5bf84d8eec None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:51.402496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 247/495] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:51.402496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aca54b-59ac-4d79-aa3e-84c0d9189708 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.402496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aca54b-59ac-4d79-aa3e-84c0d9189708 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.402496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aca54b-59ac-4d79-aa3e-84c0d9189708 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.402496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 248/496] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:51.402496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aca54b-59ac-4d79-aa3e-84c0d9189708 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.446453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ec85a-87e1-4b61-8aaa-8af90c626bbe None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.479720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f2d08-84bc-4472-bd7c-b1e9eb3d5616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:51.480363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f2d08-84bc-4472-bd7c-b1e9eb3d5616 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.480646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f2d08-84bc-4472-bd7c-b1e9eb3d5616 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.480919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f2d08-84bc-4472-bd7c-b1e9eb3d5616 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.482862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:51.491589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f2d08-84bc-4472-bd7c-b1e9eb3d5616 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:51.493042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f2d08-84bc-4472-bd7c-b1e9eb3d5616 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d47f2d08-84bc-4472-bd7c-b1e9eb3d5616 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:27:51.506575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:51.507637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:51.508576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 249/497] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:51.509127 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f2d08-84bc-4472-bd7c-b1e9eb3d5616 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.520522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aca54b-59ac-4d79-aa3e-84c0d9189708 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.522091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:51.558572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a1db-27bd-49ea-a0ae-889da2c27934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:51.559552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a1db-27bd-49ea-a0ae-889da2c27934 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.559999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a1db-27bd-49ea-a0ae-889da2c27934 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.560413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a1db-27bd-49ea-a0ae-889da2c27934 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.561420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a1db-27bd-49ea-a0ae-889da2c27934 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:51.561865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a1db-27bd-49ea-a0ae-889da2c27934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:51.563701 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a1db-27bd-49ea-a0ae-889da2c27934 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:51.572845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 249/498] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:51.574193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea8554-65ff-419d-8db5-f3819122270d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.574479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea8554-65ff-419d-8db5-f3819122270d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.574748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea8554-65ff-419d-8db5-f3819122270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.594092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-efea8554-65ff-419d-8db5-f3819122270d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:51.595916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-efea8554-65ff-419d-8db5-f3819122270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:51.625000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f2d08-84bc-4472-bd7c-b1e9eb3d5616 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.666576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159df69d-e778-4bc2-8219-a34fb35cffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:51.667258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159df69d-e778-4bc2-8219-a34fb35cffe1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.667537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159df69d-e778-4bc2-8219-a34fb35cffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.667798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159df69d-e778-4bc2-8219-a34fb35cffe1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.675539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 250/499] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:51.675539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea8554-65ff-419d-8db5-f3819122270d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.680586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159df69d-e778-4bc2-8219-a34fb35cffe1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:51.682077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159df69d-e778-4bc2-8219-a34fb35cffe1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-159df69d-e778-4bc2-8219-a34fb35cffe1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:27:51.694721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:51.695684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:51.696634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 250/500] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:51.697329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159df69d-e778-4bc2-8219-a34fb35cffe1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.768503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:51.797271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:51.806342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea8554-65ff-419d-8db5-f3819122270d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.816128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159df69d-e778-4bc2-8219-a34fb35cffe1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.846911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed8e4b-23fb-44fe-af84-0d2cfe93296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:51.847557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed8e4b-23fb-44fe-af84-0d2cfe93296e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.847835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed8e4b-23fb-44fe-af84-0d2cfe93296e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.848102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed8e4b-23fb-44fe-af84-0d2cfe93296e None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.848889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed8e4b-23fb-44fe-af84-0d2cfe93296e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:51.849191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed8e4b-23fb-44fe-af84-0d2cfe93296e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:51.850636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed8e4b-23fb-44fe-af84-0d2cfe93296e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:51.851633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1afe4-c909-4303-b9db-d195c96e6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:51.852423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1afe4-c909-4303-b9db-d195c96e6823 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:51.852847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1afe4-c909-4303-b9db-d195c96e6823 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:51.853265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1afe4-c909-4303-b9db-d195c96e6823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:51.864964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1afe4-c909-4303-b9db-d195c96e6823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:51.866591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1afe4-c909-4303-b9db-d195c96e6823 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f7e1afe4-c909-4303-b9db-d195c96e6823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:51.881216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:51.882268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:51.883254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:51.883254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:51.883254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:51.883254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:51.884742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 251/501] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:51.885666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1afe4-c909-4303-b9db-d195c96e6823 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.897375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 251/502] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:51.897375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed8e4b-23fb-44fe-af84-0d2cfe93296e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:51.990036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1afe4-c909-4303-b9db-d195c96e6823 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.994120 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed8e4b-23fb-44fe-af84-0d2cfe93296e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:51.996897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.025900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43649a89-ab08-4559-9114-5c8ecdcce4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.026539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43649a89-ab08-4559-9114-5c8ecdcce4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.026817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43649a89-ab08-4559-9114-5c8ecdcce4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.027119 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43649a89-ab08-4559-9114-5c8ecdcce4e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.028026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42236da9-f748-4ea9-b492-0a03912739e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.028631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42236da9-f748-4ea9-b492-0a03912739e2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.028909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42236da9-f748-4ea9-b492-0a03912739e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.029173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42236da9-f748-4ea9-b492-0a03912739e2 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.029947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42236da9-f748-4ea9-b492-0a03912739e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:52.030242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42236da9-f748-4ea9-b492-0a03912739e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.031729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42236da9-f748-4ea9-b492-0a03912739e2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:52.037343 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43649a89-ab08-4559-9114-5c8ecdcce4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-43649a89-ab08-4559-9114-5c8ecdcce4e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:52.042721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:52.043618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:52.044374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 252/503] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:52.045571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43649a89-ab08-4559-9114-5c8ecdcce4e5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.050352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 252/504] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Aug 4 04:27:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:52.051113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42236da9-f748-4ea9-b492-0a03912739e2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.062367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.146068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43649a89-ab08-4559-9114-5c8ecdcce4e5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:52.157257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42236da9-f748-4ea9-b492-0a03912739e2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:52.179826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bf78f-761e-4660-a983-c98ea0ae2691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.180440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf78f-761e-4660-a983-c98ea0ae2691 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.180722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf78f-761e-4660-a983-c98ea0ae2691 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.181003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bf78f-761e-4660-a983-c98ea0ae2691 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.181693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf78f-761e-4660-a983-c98ea0ae2691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:52.181999 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf78f-761e-4660-a983-c98ea0ae2691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.183401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bf78f-761e-4660-a983-c98ea0ae2691 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:52.191598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50fa5-7db5-41e0-ba4f-3c65f77fbf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.192220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50fa5-7db5-41e0-ba4f-3c65f77fbf30 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.192491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50fa5-7db5-41e0-ba4f-3c65f77fbf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.192758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50fa5-7db5-41e0-ba4f-3c65f77fbf30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.197108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 253/505] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:52.198309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbe15f-3c85-48ba-ba41-deaf8f653f54 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.198599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbe15f-3c85-48ba-ba41-deaf8f653f54 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.198919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbe15f-3c85-48ba-ba41-deaf8f653f54 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.200241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 254/506] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:52.203737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbe15f-3c85-48ba-ba41-deaf8f653f54 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.231201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.262123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb50fa5-7db5-41e0-ba4f-3c65f77fbf30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.263577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb50fa5-7db5-41e0-ba4f-3c65f77fbf30 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:52.274381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.308870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbe15f-3c85-48ba-ba41-deaf8f653f54 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:52.342577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b530ab-4255-4db0-8253-e552e2d3746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.343207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b530ab-4255-4db0-8253-e552e2d3746a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.343481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b530ab-4255-4db0-8253-e552e2d3746a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.343747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b530ab-4255-4db0-8253-e552e2d3746a None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.344979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b530ab-4255-4db0-8253-e552e2d3746a None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:52.345277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b530ab-4255-4db0-8253-e552e2d3746a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.346629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b530ab-4255-4db0-8253-e552e2d3746a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:52.354439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 255/507] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:52.355339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b530ab-4255-4db0-8253-e552e2d3746a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.370359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 253/508] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:52.370359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50fa5-7db5-41e0-ba4f-3c65f77fbf30 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.443714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.456594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b530ab-4255-4db0-8253-e552e2d3746a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:52.467695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50fa5-7db5-41e0-ba4f-3c65f77fbf30 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:52.479672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.492633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5e85f-55c4-499d-ae33-646779f070ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.493248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5e85f-55c4-499d-ae33-646779f070ed None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.493529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5e85f-55c4-499d-ae33-646779f070ed None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.493809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5e85f-55c4-499d-ae33-646779f070ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.504042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85af35f-c7c6-40f0-9628-72b5a34748eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.504681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85af35f-c7c6-40f0-9628-72b5a34748eb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.504957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85af35f-c7c6-40f0-9628-72b5a34748eb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.505226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85af35f-c7c6-40f0-9628-72b5a34748eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.512309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85af35f-c7c6-40f0-9628-72b5a34748eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.513673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85af35f-c7c6-40f0-9628-72b5a34748eb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b85af35f-c7c6-40f0-9628-72b5a34748eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:27:52.526377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:52.527351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:52.528199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 254/509] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:52.528747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258f71-7c7e-470c-809b-5442cff3a5b1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.529039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258f71-7c7e-470c-809b-5442cff3a5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.529326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258f71-7c7e-470c-809b-5442cff3a5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.549929 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b6258f71-7c7e-470c-809b-5442cff3a5b1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:52.551212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b6258f71-7c7e-470c-809b-5442cff3a5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:52.565738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5e85f-55c4-499d-ae33-646779f070ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.567233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5e85f-55c4-499d-ae33-646779f070ed None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:52.619168 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 255/510] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:52.620004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258f71-7c7e-470c-809b-5442cff3a5b1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.655011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.668908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 256/511] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:52.669736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5e85f-55c4-499d-ae33-646779f070ed None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.717342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.721082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258f71-7c7e-470c-809b-5442cff3a5b1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:52.758091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4814-5740-49ee-98fe-c1e4ee4135b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.758744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4814-5740-49ee-98fe-c1e4ee4135b6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.759115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4814-5740-49ee-98fe-c1e4ee4135b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.759388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f4814-5740-49ee-98fe-c1e4ee4135b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.769989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f4814-5740-49ee-98fe-c1e4ee4135b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.771411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f4814-5740-49ee-98fe-c1e4ee4135b6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:52.775263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5e85f-55c4-499d-ae33-646779f070ed None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-514f4814-5740-49ee-98fe-c1e4ee4135b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:52.786774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:52.787628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:52.788450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:52.788450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:52.788450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:52.788450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:52.788450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 256/512] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:52.788709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4814-5740-49ee-98fe-c1e4ee4135b6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.812274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5ea54-b9b4-447b-a653-d59babb6c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.812932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5ea54-b9b4-447b-a653-d59babb6c1db None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.813210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5ea54-b9b4-447b-a653-d59babb6c1db None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.813485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5ea54-b9b4-447b-a653-d59babb6c1db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.824023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5ea54-b9b4-447b-a653-d59babb6c1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.825516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5ea54-b9b4-447b-a653-d59babb6c1db None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5db5ea54-b9b4-447b-a653-d59babb6c1db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:52.840232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:52.841271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:52.847484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:52.847484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:52.847484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:52.847484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:52.847484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 257/513] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:52.847484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5ea54-b9b4-447b-a653-d59babb6c1db None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.883977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.890490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f4814-5740-49ee-98fe-c1e4ee4135b6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:52.924247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c86f3-e408-4e72-9fb3-b5bc54af30e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.924933 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c86f3-e408-4e72-9fb3-b5bc54af30e7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.925269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c86f3-e408-4e72-9fb3-b5bc54af30e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.925543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c86f3-e408-4e72-9fb3-b5bc54af30e7 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.926325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c86f3-e408-4e72-9fb3-b5bc54af30e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:52.926622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c86f3-e408-4e72-9fb3-b5bc54af30e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.928072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c86f3-e408-4e72-9fb3-b5bc54af30e7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:52.944446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5ea54-b9b4-447b-a653-d59babb6c1db None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:52.946250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 257/514] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:52.947067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c86f3-e408-4e72-9fb3-b5bc54af30e7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:52.958616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:52.983100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323d838-e264-4f9c-8cb9-e21c628ccac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:52.983755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323d838-e264-4f9c-8cb9-e21c628ccac2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:52.984032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323d838-e264-4f9c-8cb9-e21c628ccac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:52.984299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323d838-e264-4f9c-8cb9-e21c628ccac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:52.994636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323d838-e264-4f9c-8cb9-e21c628ccac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:52.996107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323d838-e264-4f9c-8cb9-e21c628ccac2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f323d838-e264-4f9c-8cb9-e21c628ccac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:53.010229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:53.011345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:53.012199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:53.012199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:53.012199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:53.012199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:53.012199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 258/515] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:53.012199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323d838-e264-4f9c-8cb9-e21c628ccac2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.052627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c86f3-e408-4e72-9fb3-b5bc54af30e7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.087440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3941477-185f-4105-bf6d-5758305cf2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.088075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3941477-185f-4105-bf6d-5758305cf2cc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.088350 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3941477-185f-4105-bf6d-5758305cf2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.088622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3941477-185f-4105-bf6d-5758305cf2cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.099191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3941477-185f-4105-bf6d-5758305cf2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.100616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3941477-185f-4105-bf6d-5758305cf2cc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.101493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:53.111207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323d838-e264-4f9c-8cb9-e21c628ccac2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f3941477-185f-4105-bf6d-5758305cf2cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:53.115568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:53.116448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:53.117260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:53.117260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:53.117260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:53.117260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:53.117260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 258/516] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:53.117515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3941477-185f-4105-bf6d-5758305cf2cc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.144060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009aac6-276e-42c3-9803-60bf1bc28b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.144673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009aac6-276e-42c3-9803-60bf1bc28b5b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.144955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009aac6-276e-42c3-9803-60bf1bc28b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.145230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009aac6-276e-42c3-9803-60bf1bc28b5b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.145919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009aac6-276e-42c3-9803-60bf1bc28b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:53.146225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009aac6-276e-42c3-9803-60bf1bc28b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.147637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009aac6-276e-42c3-9803-60bf1bc28b5b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.159569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 259/517] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:53.160355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009aac6-276e-42c3-9803-60bf1bc28b5b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.179083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:53.218196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3941477-185f-4105-bf6d-5758305cf2cc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.251951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fc5b5-3bbe-4c67-bf8c-1f85a40c656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.252557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fc5b5-3bbe-4c67-bf8c-1f85a40c656a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.252831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fc5b5-3bbe-4c67-bf8c-1f85a40c656a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.253101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fc5b5-3bbe-4c67-bf8c-1f85a40c656a None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.253781 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fc5b5-3bbe-4c67-bf8c-1f85a40c656a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:53.254083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fc5b5-3bbe-4c67-bf8c-1f85a40c656a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.255460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312fc5b5-3bbe-4c67-bf8c-1f85a40c656a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.260503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009aac6-276e-42c3-9803-60bf1bc28b5b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.266881 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 259/518] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:53.267713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fc5b5-3bbe-4c67-bf8c-1f85a40c656a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.300457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4aca9-07ec-41aa-9d42-594630bfd8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.301063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4aca9-07ec-41aa-9d42-594630bfd8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.301342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4aca9-07ec-41aa-9d42-594630bfd8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.301616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4aca9-07ec-41aa-9d42-594630bfd8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.322219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:53.367243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fc5b5-3bbe-4c67-bf8c-1f85a40c656a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.369386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4aca9-07ec-41aa-9d42-594630bfd8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.370869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4aca9-07ec-41aa-9d42-594630bfd8c1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.389170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:53.401760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380cfed-0a10-4e79-9c49-c772482374a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.402366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380cfed-0a10-4e79-9c49-c772482374a2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.402642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380cfed-0a10-4e79-9c49-c772482374a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.402912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380cfed-0a10-4e79-9c49-c772482374a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.403651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380cfed-0a10-4e79-9c49-c772482374a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:53.403945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380cfed-0a10-4e79-9c49-c772482374a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.405306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380cfed-0a10-4e79-9c49-c772482374a2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.417222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 260/519] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:53.418011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380cfed-0a10-4e79-9c49-c772482374a2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.471958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 260/520] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:53.473063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4aca9-07ec-41aa-9d42-594630bfd8c1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.526944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380cfed-0a10-4e79-9c49-c772482374a2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.527913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:53.561849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1de36-5261-4b33-8eb3-46cfec24ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.562456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1de36-5261-4b33-8eb3-46cfec24ed1b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.562730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1de36-5261-4b33-8eb3-46cfec24ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.563042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1de36-5261-4b33-8eb3-46cfec24ed1b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.563720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1de36-5261-4b33-8eb3-46cfec24ed1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:53.564022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1de36-5261-4b33-8eb3-46cfec24ed1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.565402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1de36-5261-4b33-8eb3-46cfec24ed1b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.576766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 261/521] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:53.577474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1de36-5261-4b33-8eb3-46cfec24ed1b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.578178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4aca9-07ec-41aa-9d42-594630bfd8c1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.613324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa6d72-c38d-4481-8ddd-bdaafffba03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.613960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa6d72-c38d-4481-8ddd-bdaafffba03a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.614237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa6d72-c38d-4481-8ddd-bdaafffba03a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.614509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa6d72-c38d-4481-8ddd-bdaafffba03a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.621563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa6d72-c38d-4481-8ddd-bdaafffba03a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.622815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:53.623029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa6d72-c38d-4481-8ddd-bdaafffba03a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c7fa6d72-c38d-4481-8ddd-bdaafffba03a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:27:53.635627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:53.636524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:53.637385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 261/522] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:53.637932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa6d72-c38d-4481-8ddd-bdaafffba03a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.684529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1de36-5261-4b33-8eb3-46cfec24ed1b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.722376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0bf59-ce65-41ba-9d95-5c7724fb86ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.723415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0bf59-ce65-41ba-9d95-5c7724fb86ca None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.723791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0bf59-ce65-41ba-9d95-5c7724fb86ca None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.724216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0bf59-ce65-41ba-9d95-5c7724fb86ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.732186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0bf59-ce65-41ba-9d95-5c7724fb86ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.733625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0bf59-ce65-41ba-9d95-5c7724fb86ca None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.743707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa6d72-c38d-4481-8ddd-bdaafffba03a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-adf0bf59-ce65-41ba-9d95-5c7724fb86ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:27:53.745737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:53.746518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:53.747385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:27:53.747385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:27:53.747385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:27:53.747385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:27:53.747385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:27:53.747385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:27:53.747385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:53.747385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:53.751306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 262/523] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:53.752612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0bf59-ce65-41ba-9d95-5c7724fb86ca None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.758151 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:53.780549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f876e1-c0cd-4ca2-80b6-8fd4b5caa9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.781158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f876e1-c0cd-4ca2-80b6-8fd4b5caa9b5 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.781437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f876e1-c0cd-4ca2-80b6-8fd4b5caa9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.781798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f876e1-c0cd-4ca2-80b6-8fd4b5caa9b5 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.782482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f876e1-c0cd-4ca2-80b6-8fd4b5caa9b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.783976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f876e1-c0cd-4ca2-80b6-8fd4b5caa9b5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.806273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 262/524] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:27:53 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:27:53.807135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f876e1-c0cd-4ca2-80b6-8fd4b5caa9b5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.871368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0bf59-ce65-41ba-9d95-5c7724fb86ca None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.873022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:53.911665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372a610-da42-4bea-bde6-31078a1c1388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.912344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372a610-da42-4bea-bde6-31078a1c1388 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.912627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372a610-da42-4bea-bde6-31078a1c1388 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.912899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372a610-da42-4bea-bde6-31078a1c1388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.924816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372a610-da42-4bea-bde6-31078a1c1388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.926443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372a610-da42-4bea-bde6-31078a1c1388 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:53.934568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f876e1-c0cd-4ca2-80b6-8fd4b5caa9b5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b372a610-da42-4bea-bde6-31078a1c1388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:53.944072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:53.945176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:53.946204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:53.946204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:53.946204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:53.946204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:53.948055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 263/525] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:53.949063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372a610-da42-4bea-bde6-31078a1c1388 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:53.980515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd7abf-9dfc-4b9d-8af5-d092c5a85f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:53.981168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd7abf-9dfc-4b9d-8af5-d092c5a85f8a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:53.981449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd7abf-9dfc-4b9d-8af5-d092c5a85f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:53.981721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd7abf-9dfc-4b9d-8af5-d092c5a85f8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:53.989599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd7abf-9dfc-4b9d-8af5-d092c5a85f8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:53.991077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd7abf-9dfc-4b9d-8af5-d092c5a85f8a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-37dd7abf-9dfc-4b9d-8af5-d092c5a85f8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:27:54.004236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:54.005102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 263/526] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:54.005944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd7abf-9dfc-4b9d-8af5-d092c5a85f8a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:54.039854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:54.071100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372a610-da42-4bea-bde6-31078a1c1388 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:54.107843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b09e6-c77e-4fae-85a7-55af973a65e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:54.108468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b09e6-c77e-4fae-85a7-55af973a65e8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:54.108748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b09e6-c77e-4fae-85a7-55af973a65e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:54.109023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b09e6-c77e-4fae-85a7-55af973a65e8 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:54.109875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b09e6-c77e-4fae-85a7-55af973a65e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:54.110181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b09e6-c77e-4fae-85a7-55af973a65e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:54.111702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b09e6-c77e-4fae-85a7-55af973a65e8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.121811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd7abf-9dfc-4b9d-8af5-d092c5a85f8a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:54.131673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 264/527] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Aug 4 04:27:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:54.132303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b09e6-c77e-4fae-85a7-55af973a65e8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:54.147331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:54.159288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f42a8b-a15a-4f10-ad3e-ee4c14aac886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:54.159915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f42a8b-a15a-4f10-ad3e-ee4c14aac886 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:54.160192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f42a8b-a15a-4f10-ad3e-ee4c14aac886 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:54.160456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f42a8b-a15a-4f10-ad3e-ee4c14aac886 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:54.161210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f42a8b-a15a-4f10-ad3e-ee4c14aac886 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:54.161514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f42a8b-a15a-4f10-ad3e-ee4c14aac886 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:54.162945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f42a8b-a15a-4f10-ad3e-ee4c14aac886 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.182128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 264/528] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:54.182775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f42a8b-a15a-4f10-ad3e-ee4c14aac886 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:54.247748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b09e6-c77e-4fae-85a7-55af973a65e8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:54.282350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:54.287233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a356-c21e-4d1c-8b1d-e8ad7defa54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:54.287798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a356-c21e-4d1c-8b1d-e8ad7defa54b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:54.288078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a356-c21e-4d1c-8b1d-e8ad7defa54b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:54.288348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a356-c21e-4d1c-8b1d-e8ad7defa54b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:54.289033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a356-c21e-4d1c-8b1d-e8ad7defa54b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:54.289334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a356-c21e-4d1c-8b1d-e8ad7defa54b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:54.290704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a356-c21e-4d1c-8b1d-e8ad7defa54b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.295450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f42a8b-a15a-4f10-ad3e-ee4c14aac886 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:54.304064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 265/529] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:54.304064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a356-c21e-4d1c-8b1d-e8ad7defa54b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:54.339717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6ed26-0d5d-4e60-a693-d19f78039a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:54.340395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6ed26-0d5d-4e60-a693-d19f78039a75 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:54.340686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6ed26-0d5d-4e60-a693-d19f78039a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:54.340958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6ed26-0d5d-4e60-a693-d19f78039a75 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:54.341778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6ed26-0d5d-4e60-a693-d19f78039a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:54.342087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6ed26-0d5d-4e60-a693-d19f78039a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:54.343569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6ed26-0d5d-4e60-a693-d19f78039a75 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.361692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 265/530] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:54.361692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6ed26-0d5d-4e60-a693-d19f78039a75 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:54.391949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:54.425312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a356-c21e-4d1c-8b1d-e8ad7defa54b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:54.460700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6b110-c1ca-4fc1-988a-c7e0483102d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:54.461316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6b110-c1ca-4fc1-988a-c7e0483102d7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:54.461599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6b110-c1ca-4fc1-988a-c7e0483102d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:54.461875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6b110-c1ca-4fc1-988a-c7e0483102d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:54.477427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6ed26-0d5d-4e60-a693-d19f78039a75 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:54.522389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d6f3-7596-4837-b0ec-4337f01bb6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:54.523283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d6f3-7596-4837-b0ec-4337f01bb6fa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:54.523580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d6f3-7596-4837-b0ec-4337f01bb6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:54.524235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d6f3-7596-4837-b0ec-4337f01bb6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:54.525341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1d6f3-7596-4837-b0ec-4337f01bb6fa None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=bd26e2ac2578438e854d51d8eed26463) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:54.525649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1d6f3-7596-4837-b0ec-4337f01bb6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:54.528033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1d6f3-7596-4837-b0ec-4337f01bb6fa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.534019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6b110-c1ca-4fc1-988a-c7e0483102d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:54.543364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 266/531] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/role_assignments?user.id=bd26e2ac2578438e854d51d8eed26463&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:54.543584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6b110-c1ca-4fc1-988a-c7e0483102d7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.543665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d6f3-7596-4837-b0ec-4337f01bb6fa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:54.566788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:54.619335 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:54.653829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 266/532] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:54.654693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6b110-c1ca-4fc1-988a-c7e0483102d7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:54.669664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d6f3-7596-4837-b0ec-4337f01bb6fa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:54.708416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f59c5c-439d-4e45-8aad-88bcdf8cae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:54.709223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f59c5c-439d-4e45-8aad-88bcdf8cae84 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:54.709652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f59c5c-439d-4e45-8aad-88bcdf8cae84 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:54.710016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f59c5c-439d-4e45-8aad-88bcdf8cae84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:54.718859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f59c5c-439d-4e45-8aad-88bcdf8cae84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:54.720529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f59c5c-439d-4e45-8aad-88bcdf8cae84 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-90f59c5c-439d-4e45-8aad-88bcdf8cae84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:27:54.733666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:54.734536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:54.735995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:27:54.735995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:27:54.735995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:27:54.735995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:27:54.735995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:27:54.735995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:27:54.735995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:54.735995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:54.736863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 267/533] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:54.737689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f59c5c-439d-4e45-8aad-88bcdf8cae84 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:54.795302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6b110-c1ca-4fc1-988a-c7e0483102d7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:54.829746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:54.833314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0c8a2-da5f-4c6e-a46e-57766406071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:54.834104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0c8a2-da5f-4c6e-a46e-57766406071c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:54.834628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0c8a2-da5f-4c6e-a46e-57766406071c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:54.835069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0c8a2-da5f-4c6e-a46e-57766406071c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:54.836022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0c8a2-da5f-4c6e-a46e-57766406071c None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=955c6cb8893c473fadd028b12bbea69d) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:54.836505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0c8a2-da5f-4c6e-a46e-57766406071c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:54.838573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0c8a2-da5f-4c6e-a46e-57766406071c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.851174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 267/534] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/role_assignments?user.id=955c6cb8893c473fadd028b12bbea69d&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:54.852395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0c8a2-da5f-4c6e-a46e-57766406071c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:54.870492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f59c5c-439d-4e45-8aad-88bcdf8cae84 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:54.918842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750292a-9a40-4c19-aa50-5ebea0dce966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:54.920786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750292a-9a40-4c19-aa50-5ebea0dce966 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:54.923728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750292a-9a40-4c19-aa50-5ebea0dce966 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:54.924986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750292a-9a40-4c19-aa50-5ebea0dce966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:54.947078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:54.952538 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750292a-9a40-4c19-aa50-5ebea0dce966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:54.954725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750292a-9a40-4c19-aa50-5ebea0dce966 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3750292a-9a40-4c19-aa50-5ebea0dce966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:54.987576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:54.988679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:54.989641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:54.989641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:54.989641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:54.989641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:54.989641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 268/535] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:54.996971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750292a-9a40-4c19-aa50-5ebea0dce966 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:55.054186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0c8a2-da5f-4c6e-a46e-57766406071c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:55.096996 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d3d27-bf82-43ba-9c10-e4510176dc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:55.097618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d3d27-bf82-43ba-9c10-e4510176dc81 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:55.097900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d3d27-bf82-43ba-9c10-e4510176dc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:55.098176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d3d27-bf82-43ba-9c10-e4510176dc81 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:55.098932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d3d27-bf82-43ba-9c10-e4510176dc81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:55.099269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d3d27-bf82-43ba-9c10-e4510176dc81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:55.100713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d3d27-bf82-43ba-9c10-e4510176dc81 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:55.123110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 268/536] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:55.126260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d3d27-bf82-43ba-9c10-e4510176dc81 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:55.196944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750292a-9a40-4c19-aa50-5ebea0dce966 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:55.231364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:55.239725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d3d27-bf82-43ba-9c10-e4510176dc81 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:55.276343 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:55.282000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301876b-a2bf-4c73-afca-299b7f5a713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:55.283151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301876b-a2bf-4c73-afca-299b7f5a713a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:55.284436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301876b-a2bf-4c73-afca-299b7f5a713a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:55.284936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301876b-a2bf-4c73-afca-299b7f5a713a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:55.285917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301876b-a2bf-4c73-afca-299b7f5a713a None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=7a7ad7efdc2849ca98386decbfd77879) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:55.286368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301876b-a2bf-4c73-afca-299b7f5a713a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:55.288039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301876b-a2bf-4c73-afca-299b7f5a713a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:55.299031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 269/537] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:55 2022] GET /identity/v3/role_assignments?user.id=7a7ad7efdc2849ca98386decbfd77879&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:55.331871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb465d-05e3-4898-90cf-17172d2cdaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:55.332512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb465d-05e3-4898-90cf-17172d2cdaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:55.332790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb465d-05e3-4898-90cf-17172d2cdaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:55.333063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb465d-05e3-4898-90cf-17172d2cdaa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:55.333783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb465d-05e3-4898-90cf-17172d2cdaa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:55.334084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb465d-05e3-4898-90cf-17172d2cdaa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:55.335546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb465d-05e3-4898-90cf-17172d2cdaa7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:55.353018 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 269/538] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:27:55.358586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301876b-a2bf-4c73-afca-299b7f5a713a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:55.480832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301876b-a2bf-4c73-afca-299b7f5a713a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:55.519192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397b88-fbb4-4809-87ba-c981a93a1dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:55.520097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397b88-fbb4-4809-87ba-c981a93a1dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:55.520526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397b88-fbb4-4809-87ba-c981a93a1dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:55.520940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53397b88-fbb4-4809-87ba-c981a93a1dc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:55.530044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53397b88-fbb4-4809-87ba-c981a93a1dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:55.531916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53397b88-fbb4-4809-87ba-c981a93a1dc1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-53397b88-fbb4-4809-87ba-c981a93a1dc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:27:55.544738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:55.545780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:55.547129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:27:55.547129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:27:55.547129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:27:55.547129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:27:55.547129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:27:55.547129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:27:55.547129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:55.547129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:55.553226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 270/539] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:55.555260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb465d-05e3-4898-90cf-17172d2cdaa7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:55.671209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb465d-05e3-4898-90cf-17172d2cdaa7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:55.708466 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099f179-3810-43fd-bc96-89c3b020cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:55.709353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099f179-3810-43fd-bc96-89c3b020cf62 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:55.709784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099f179-3810-43fd-bc96-89c3b020cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:55.710194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099f179-3810-43fd-bc96-89c3b020cf62 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:55.711185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099f179-3810-43fd-bc96-89c3b020cf62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:55.711679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099f179-3810-43fd-bc96-89c3b020cf62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:55.713272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099f179-3810-43fd-bc96-89c3b020cf62 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:55.730523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 270/540] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:55.736359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397b88-fbb4-4809-87ba-c981a93a1dc1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:55.784703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:55.909552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53397b88-fbb4-4809-87ba-c981a93a1dc1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:55.960583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d3368-74e5-4cb6-9117-78e9c1be4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:55.961363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3368-74e5-4cb6-9117-78e9c1be4baf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:55.961746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3368-74e5-4cb6-9117-78e9c1be4baf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:55.962115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d3368-74e5-4cb6-9117-78e9c1be4baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:55.963022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d3368-74e5-4cb6-9117-78e9c1be4baf None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=c426cc367a1843d38978d3b8e636276e) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:55.963455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d3368-74e5-4cb6-9117-78e9c1be4baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:55.965099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d3368-74e5-4cb6-9117-78e9c1be4baf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:55.975384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 271/541] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:55 2022] GET /identity/v3/role_assignments?user.id=c426cc367a1843d38978d3b8e636276e&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:56.202979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669c762-b211-42e0-9ebf-70a5b4570a73 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:56.202979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669c762-b211-42e0-9ebf-70a5b4570a73 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:56.202979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669c762-b211-42e0-9ebf-70a5b4570a73 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:56.204932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 271/542] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:56.210443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3285-fdfb-435b-853f-dc19c4a6b8c5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:56.210727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3285-fdfb-435b-853f-dc19c4a6b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:56.211030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e3285-fdfb-435b-853f-dc19c4a6b8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:56.235461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0e1e3285-fdfb-435b-853f-dc19c4a6b8c5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:56.240482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0e1e3285-fdfb-435b-853f-dc19c4a6b8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:56.328662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 272/543] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:56.364231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669c762-b211-42e0-9ebf-70a5b4570a73 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:56.435383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:56.507273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669c762-b211-42e0-9ebf-70a5b4570a73 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:56.565701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ce517-1f8c-43d4-bb61-2768a27210b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:56.566819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ce517-1f8c-43d4-bb61-2768a27210b1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:56.567321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ce517-1f8c-43d4-bb61-2768a27210b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:56.567790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ce517-1f8c-43d4-bb61-2768a27210b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:56.579350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ce517-1f8c-43d4-bb61-2768a27210b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7b5ce517-1f8c-43d4-bb61-2768a27210b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:56.585385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:56.586236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:56.587055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:56.589792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 272/544] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:56.596116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3285-fdfb-435b-853f-dc19c4a6b8c5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:56.628921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:56.729830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e3285-fdfb-435b-853f-dc19c4a6b8c5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:56.767923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107021a2-e385-4e21-918e-39595afb247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:56.768762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107021a2-e385-4e21-918e-39595afb247a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:56.769194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107021a2-e385-4e21-918e-39595afb247a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:56.769622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107021a2-e385-4e21-918e-39595afb247a None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:56.770476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107021a2-e385-4e21-918e-39595afb247a None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:56.770920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107021a2-e385-4e21-918e-39595afb247a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:56.772465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107021a2-e385-4e21-918e-39595afb247a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:56.781299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 273/545] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:27:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:56.787221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ce517-1f8c-43d4-bb61-2768a27210b1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:56.942498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ce517-1f8c-43d4-bb61-2768a27210b1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:56.944952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:56.978323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5420b-ea8f-4888-a754-47bebac153fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:56.979053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5420b-ea8f-4888-a754-47bebac153fa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:56.979340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5420b-ea8f-4888-a754-47bebac153fa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:56.979664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5420b-ea8f-4888-a754-47bebac153fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:56.990705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5420b-ea8f-4888-a754-47bebac153fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:56.992300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5420b-ea8f-4888-a754-47bebac153fa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-85f5420b-ea8f-4888-a754-47bebac153fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:57.007453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:57.008335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:57.009170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:57.009170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:57.009170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:57.009170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:57.009170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 273/546] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:57.014446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107021a2-e385-4e21-918e-39595afb247a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:57.135396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:57.155448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107021a2-e385-4e21-918e-39595afb247a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:57.190215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e5957-f817-49b6-ac41-c248ee62669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:57.190834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e5957-f817-49b6-ac41-c248ee62669e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.191142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e5957-f817-49b6-ac41-c248ee62669e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.191412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e5957-f817-49b6-ac41-c248ee62669e None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.192108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e5957-f817-49b6-ac41-c248ee62669e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:57.192409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e5957-f817-49b6-ac41-c248ee62669e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:57.193774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e5957-f817-49b6-ac41-c248ee62669e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:57.206594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 274/547] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:57.214160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5420b-ea8f-4888-a754-47bebac153fa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:57.259792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8c00c-f219-40b4-9c6a-b5e1065efd46 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.260079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8c00c-f219-40b4-9c6a-b5e1065efd46 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.260257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8c00c-f219-40b4-9c6a-b5e1065efd46 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.261862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 275/548] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:27:57.267239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7732c-bbbb-45d5-967e-db4bc790f830 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.267525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7732c-bbbb-45d5-967e-db4bc790f830 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.267815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7732c-bbbb-45d5-967e-db4bc790f830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.285794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c6e7732c-bbbb-45d5-967e-db4bc790f830 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:57.286994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c6e7732c-bbbb-45d5-967e-db4bc790f830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:57.358425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 276/549] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:27:57.359144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5420b-ea8f-4888-a754-47bebac153fa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:57.360267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f50b88-f4c0-4bb1-8c77-6e7fc81886f1 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.360557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f50b88-f4c0-4bb1-8c77-6e7fc81886f1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.371300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f50b88-f4c0-4bb1-8c77-6e7fc81886f1 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.373114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 277/550] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:57 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:57.378566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7028e1-7f4e-480b-a434-6368ce09039d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.378854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7028e1-7f4e-480b-a434-6368ce09039d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.379154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7028e1-7f4e-480b-a434-6368ce09039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.403221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ce206-acaf-4e87-85e1-9082cd29a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:57.403935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ce206-acaf-4e87-85e1-9082cd29a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.404219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ce206-acaf-4e87-85e1-9082cd29a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.404492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ce206-acaf-4e87-85e1-9082cd29a0a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.406381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5f7028e1-7f4e-480b-a434-6368ce09039d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:57.407825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5f7028e1-7f4e-480b-a434-6368ce09039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:57.414671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ce206-acaf-4e87-85e1-9082cd29a0a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:57.416808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ce206-acaf-4e87-85e1-9082cd29a0a1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0f1ce206-acaf-4e87-85e1-9082cd29a0a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:27:57.431764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:57.433204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:27:57.434236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:57.437618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 274/551] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:27:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:57.439082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ce206-acaf-4e87-85e1-9082cd29a0a1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:57.460976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:57.483076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:57.491918 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 278/552] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:57.492743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7028e1-7f4e-480b-a434-6368ce09039d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:57.560038 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ce206-acaf-4e87-85e1-9082cd29a0a1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:57.597123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7028e1-7f4e-480b-a434-6368ce09039d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:57.598960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87982fd-f98f-4155-97f8-bedcc5b7cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:57.599925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87982fd-f98f-4155-97f8-bedcc5b7cbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.600398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87982fd-f98f-4155-97f8-bedcc5b7cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.600862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87982fd-f98f-4155-97f8-bedcc5b7cbf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.613041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87982fd-f98f-4155-97f8-bedcc5b7cbf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e87982fd-f98f-4155-97f8-bedcc5b7cbf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:57.619146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:57.620022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:57.620966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:57.628082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 275/553] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:57.629246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87982fd-f98f-4155-97f8-bedcc5b7cbf0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:57.634046 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57da5e-a0b3-4754-9572-95f6b3ba3372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:57.634753 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57da5e-a0b3-4754-9572-95f6b3ba3372 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.635137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57da5e-a0b3-4754-9572-95f6b3ba3372 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.635482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57da5e-a0b3-4754-9572-95f6b3ba3372 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.636369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57da5e-a0b3-4754-9572-95f6b3ba3372 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:57.636748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57da5e-a0b3-4754-9572-95f6b3ba3372 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:57.638244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57da5e-a0b3-4754-9572-95f6b3ba3372 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:57.661159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 279/554] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Aug 4 04:27:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:57.661159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57da5e-a0b3-4754-9572-95f6b3ba3372 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:57.721897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:57.722398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:57.751323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87982fd-f98f-4155-97f8-bedcc5b7cbf0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:57.778258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57da5e-a0b3-4754-9572-95f6b3ba3372 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:57.792371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04401089-fe5e-4e6a-b2c5-7d852ee22e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:57.793410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04401089-fe5e-4e6a-b2c5-7d852ee22e44 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.793960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04401089-fe5e-4e6a-b2c5-7d852ee22e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.794408 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04401089-fe5e-4e6a-b2c5-7d852ee22e44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.807286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04401089-fe5e-4e6a-b2c5-7d852ee22e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-04401089-fe5e-4e6a-b2c5-7d852ee22e44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:57.813386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:57.814318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:57.815276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:57.816537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf746af6-d0da-4ec0-a030-f71639660895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:57.817224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf746af6-d0da-4ec0-a030-f71639660895 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.817576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf746af6-d0da-4ec0-a030-f71639660895 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.817915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf746af6-d0da-4ec0-a030-f71639660895 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.818268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 276/555] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:57.819042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf746af6-d0da-4ec0-a030-f71639660895 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:57.819456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf746af6-d0da-4ec0-a030-f71639660895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:57.819563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04401089-fe5e-4e6a-b2c5-7d852ee22e44 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:57.820989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf746af6-d0da-4ec0-a030-f71639660895 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:57.834927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 280/556] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:27:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:57.834927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf746af6-d0da-4ec0-a030-f71639660895 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:57.948204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04401089-fe5e-4e6a-b2c5-7d852ee22e44 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:57.959312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf746af6-d0da-4ec0-a030-f71639660895 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:57.977516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:57.985326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770f1cd-f170-4ef3-ae5b-06c92b4f4dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:57.985952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770f1cd-f170-4ef3-ae5b-06c92b4f4dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:57.986304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770f1cd-f170-4ef3-ae5b-06c92b4f4dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:57.986506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770f1cd-f170-4ef3-ae5b-06c92b4f4dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:57.991687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:57.999587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632df8f-e64b-460d-9ee1-bf1a3d0731bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:58.000285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632df8f-e64b-460d-9ee1-bf1a3d0731bb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.000663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632df8f-e64b-460d-9ee1-bf1a3d0731bb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.001009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632df8f-e64b-460d-9ee1-bf1a3d0731bb None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.001787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632df8f-e64b-460d-9ee1-bf1a3d0731bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:58.002154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632df8f-e64b-460d-9ee1-bf1a3d0731bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:58.003642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632df8f-e64b-460d-9ee1-bf1a3d0731bb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:58.014394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 281/557] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:27:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:58.015828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632df8f-e64b-460d-9ee1-bf1a3d0731bb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.061631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770f1cd-f170-4ef3-ae5b-06c92b4f4dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:58.063184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770f1cd-f170-4ef3-ae5b-06c92b4f4dd5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:58.132156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632df8f-e64b-460d-9ee1-bf1a3d0731bb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:58.168349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decad3c4-7afb-4c38-a121-3484cf0b5799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:58.169069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decad3c4-7afb-4c38-a121-3484cf0b5799 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.169338 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decad3c4-7afb-4c38-a121-3484cf0b5799 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.169837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decad3c4-7afb-4c38-a121-3484cf0b5799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.177483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 277/558] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:27:58.179541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139164-852e-4f77-a3f2-af11c605cc02 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.180116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139164-852e-4f77-a3f2-af11c605cc02 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.180631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139164-852e-4f77-a3f2-af11c605cc02 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.181182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decad3c4-7afb-4c38-a121-3484cf0b5799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:58.182494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decad3c4-7afb-4c38-a121-3484cf0b5799 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:58.183105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 278/559] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:58.184085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139164-852e-4f77-a3f2-af11c605cc02 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-decad3c4-7afb-4c38-a121-3484cf0b5799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:58.197951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:58.199085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:58.200145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:58.200145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:58.200145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:58.200145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:58.200145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 282/560] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:58.200423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decad3c4-7afb-4c38-a121-3484cf0b5799 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.234516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:58.244144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:58.322511 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139164-852e-4f77-a3f2-af11c605cc02 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:58.339825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decad3c4-7afb-4c38-a121-3484cf0b5799 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:58.358655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed728beb-e1ab-4c48-b70f-d6080112c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:58.359325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed728beb-e1ab-4c48-b70f-d6080112c40f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.359612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed728beb-e1ab-4c48-b70f-d6080112c40f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.359911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed728beb-e1ab-4c48-b70f-d6080112c40f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.369981 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed728beb-e1ab-4c48-b70f-d6080112c40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:58.371571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed728beb-e1ab-4c48-b70f-d6080112c40f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:58.373111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb0391-6d96-4477-b2c4-b1e979c41b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:58.373747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb0391-6d96-4477-b2c4-b1e979c41b93 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.374026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb0391-6d96-4477-b2c4-b1e979c41b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.374301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb0391-6d96-4477-b2c4-b1e979c41b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.385256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb0391-6d96-4477-b2c4-b1e979c41b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:58.386520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb0391-6d96-4477-b2c4-b1e979c41b93 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ed728beb-e1ab-4c48-b70f-d6080112c40f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:58.387180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:58.388230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:58.389298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:58.389298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:58.389298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:58.389298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:58.389298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 279/561] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:58.389621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b547b-3c9f-4914-af4a-24329d745c30 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.389817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b547b-3c9f-4914-af4a-24329d745c30 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.390093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b547b-3c9f-4914-af4a-24329d745c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-63eb0391-6d96-4477-b2c4-b1e979c41b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:58.407915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:58.408812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:58.409730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:58.409730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:58.409730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:58.409730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:58.409939 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a34b547b-3c9f-4914-af4a-24329d745c30 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:58.410021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 283/562] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:58.410021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb0391-6d96-4477-b2c4-b1e979c41b93 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.410273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a34b547b-3c9f-4914-af4a-24329d745c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:58.480548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 280/563] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:58.481794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b16b9f-e967-4e20-9d31-2872b06282f5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.482076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b16b9f-e967-4e20-9d31-2872b06282f5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.482344 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b16b9f-e967-4e20-9d31-2872b06282f5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.487348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 281/564] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:27:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:27:58.488781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b16b9f-e967-4e20-9d31-2872b06282f5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.494327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:58.508831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:58.517374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb0391-6d96-4477-b2c4-b1e979c41b93 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:58.550090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995e10d-473b-4803-91fc-1fd8fafd219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:58.550706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e10d-473b-4803-91fc-1fd8fafd219b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.551016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e10d-473b-4803-91fc-1fd8fafd219b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.551294 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e10d-473b-4803-91fc-1fd8fafd219b None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.551981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995e10d-473b-4803-91fc-1fd8fafd219b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:58.552285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995e10d-473b-4803-91fc-1fd8fafd219b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:58.553636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995e10d-473b-4803-91fc-1fd8fafd219b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:58.565822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 284/565] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:58.566790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995e10d-473b-4803-91fc-1fd8fafd219b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.595338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b16b9f-e967-4e20-9d31-2872b06282f5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:58.629541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e932c9-2ab5-4a4c-9c80-897de9834d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:58.630163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e932c9-2ab5-4a4c-9c80-897de9834d83 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.630440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e932c9-2ab5-4a4c-9c80-897de9834d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.630712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e932c9-2ab5-4a4c-9c80-897de9834d83 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.631443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e932c9-2ab5-4a4c-9c80-897de9834d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:58.631744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e932c9-2ab5-4a4c-9c80-897de9834d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:58.633162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e932c9-2ab5-4a4c-9c80-897de9834d83 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:58.645336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 282/566] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:58.646461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857bbe3-0474-43c1-a2a8-604935666e32 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.646747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857bbe3-0474-43c1-a2a8-604935666e32 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.647050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857bbe3-0474-43c1-a2a8-604935666e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.664034 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9857bbe3-0474-43c1-a2a8-604935666e32 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:27:58.665222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9857bbe3-0474-43c1-a2a8-604935666e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:27:58.675480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995e10d-473b-4803-91fc-1fd8fafd219b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:58.711670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15437a5b-7d7d-4a5d-943e-861d2c2830c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:58.712288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437a5b-7d7d-4a5d-943e-861d2c2830c9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.712568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437a5b-7d7d-4a5d-943e-861d2c2830c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.712840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437a5b-7d7d-4a5d-943e-861d2c2830c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.713525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15437a5b-7d7d-4a5d-943e-861d2c2830c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:58.713827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15437a5b-7d7d-4a5d-943e-861d2c2830c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:58.715221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15437a5b-7d7d-4a5d-943e-861d2c2830c9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:58.726187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 285/567] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:58.726969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15437a5b-7d7d-4a5d-943e-861d2c2830c9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.729670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:58.739308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 283/568] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:27:58.739308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857bbe3-0474-43c1-a2a8-604935666e32 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.747534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:58.837916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857bbe3-0474-43c1-a2a8-604935666e32 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:58.838846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15437a5b-7d7d-4a5d-943e-861d2c2830c9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:58.871431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c38fe-2d28-4fdc-847a-7b84cb4e69c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:58.871877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094021db-f0b7-45b5-b70d-2259a72dca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:58.872071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c38fe-2d28-4fdc-847a-7b84cb4e69c7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.872352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c38fe-2d28-4fdc-847a-7b84cb4e69c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.872506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094021db-f0b7-45b5-b70d-2259a72dca14 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:58.872620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c38fe-2d28-4fdc-847a-7b84cb4e69c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.872782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094021db-f0b7-45b5-b70d-2259a72dca14 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:58.873048 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094021db-f0b7-45b5-b70d-2259a72dca14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:58.880326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c38fe-2d28-4fdc-847a-7b84cb4e69c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:58.881779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c38fe-2d28-4fdc-847a-7b84cb4e69c7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:58.885366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094021db-f0b7-45b5-b70d-2259a72dca14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-094021db-f0b7-45b5-b70d-2259a72dca14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:58.890664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:58.891606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:58.892450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 286/569] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:58.893152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094021db-f0b7-45b5-b70d-2259a72dca14 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c62c38fe-2d28-4fdc-847a-7b84cb4e69c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:27:58.894099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:58.895049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 284/570] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:58.897771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c38fe-2d28-4fdc-847a-7b84cb4e69c7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:58.956938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:58.967451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:58.996268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094021db-f0b7-45b5-b70d-2259a72dca14 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.003552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c38fe-2d28-4fdc-847a-7b84cb4e69c7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.030734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d970e-57a6-421d-8bdb-fe76ba91b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.031398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d970e-57a6-421d-8bdb-fe76ba91b781 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.032205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d970e-57a6-421d-8bdb-fe76ba91b781 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.032481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d970e-57a6-421d-8bdb-fe76ba91b781 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.037358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f091d2-aca6-45f1-8359-a642b293db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.038065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f091d2-aca6-45f1-8359-a642b293db10 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.038346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f091d2-aca6-45f1-8359-a642b293db10 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.038621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f091d2-aca6-45f1-8359-a642b293db10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.040249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d970e-57a6-421d-8bdb-fe76ba91b781 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.041695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d970e-57a6-421d-8bdb-fe76ba91b781 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.045407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f091d2-aca6-45f1-8359-a642b293db10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.047114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f091d2-aca6-45f1-8359-a642b293db10 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4e6d970e-57a6-421d-8bdb-fe76ba91b781 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:27:59.053156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:59.054223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 287/571] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:59.055417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d970e-57a6-421d-8bdb-fe76ba91b781 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c7f091d2-aca6-45f1-8359-a642b293db10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:27:59.061930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:59.063646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 285/572] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:27:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:59.064867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f091d2-aca6-45f1-8359-a642b293db10 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.158191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d970e-57a6-421d-8bdb-fe76ba91b781 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.163544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f091d2-aca6-45f1-8359-a642b293db10 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.180281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.190591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.193676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5692633-2dc2-415f-a5be-082d245731b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.194509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5692633-2dc2-415f-a5be-082d245731b2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.194789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5692633-2dc2-415f-a5be-082d245731b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.195080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5692633-2dc2-415f-a5be-082d245731b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.198640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388c448-0aeb-47e2-9667-d363049deb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.199272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388c448-0aeb-47e2-9667-d363049deb9c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.199552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388c448-0aeb-47e2-9667-d363049deb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.199820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388c448-0aeb-47e2-9667-d363049deb9c None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.200606 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388c448-0aeb-47e2-9667-d363049deb9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:59.200908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388c448-0aeb-47e2-9667-d363049deb9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.202310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388c448-0aeb-47e2-9667-d363049deb9c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.205754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5692633-2dc2-415f-a5be-082d245731b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b5692633-2dc2-415f-a5be-082d245731b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:27:59.211121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:59.212165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:27:59.212982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:59.215123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 288/573] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:59.216070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5692633-2dc2-415f-a5be-082d245731b2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.238585 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 286/574] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:59.239455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388c448-0aeb-47e2-9667-d363049deb9c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.316775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5692633-2dc2-415f-a5be-082d245731b2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.345844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388c448-0aeb-47e2-9667-d363049deb9c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.350499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c30a06-d75d-40b4-8031-9b06e641517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.351147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30a06-d75d-40b4-8031-9b06e641517c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.351429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30a06-d75d-40b4-8031-9b06e641517c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.351701 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30a06-d75d-40b4-8031-9b06e641517c None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.352409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c30a06-d75d-40b4-8031-9b06e641517c None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:59.352712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c30a06-d75d-40b4-8031-9b06e641517c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.354080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c30a06-d75d-40b4-8031-9b06e641517c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.362469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 289/575] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:59.363271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c30a06-d75d-40b4-8031-9b06e641517c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.384065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8b75e-f08d-4494-bb6b-fd7ea0f86b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.384696 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8b75e-f08d-4494-bb6b-fd7ea0f86b21 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.384980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8b75e-f08d-4494-bb6b-fd7ea0f86b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.385256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8b75e-f08d-4494-bb6b-fd7ea0f86b21 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.386064 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8b75e-f08d-4494-bb6b-fd7ea0f86b21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:59.386361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8b75e-f08d-4494-bb6b-fd7ea0f86b21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.387835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8b75e-f08d-4494-bb6b-fd7ea0f86b21 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.407109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 287/576] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:59.408023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8b75e-f08d-4494-bb6b-fd7ea0f86b21 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.414263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.453539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.471118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c30a06-d75d-40b4-8031-9b06e641517c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.507991 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2e2e1-653d-413b-ba02-a50917b969ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.508494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8b75e-f08d-4494-bb6b-fd7ea0f86b21 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.508603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2e2e1-653d-413b-ba02-a50917b969ea None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.508861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2e2e1-653d-413b-ba02-a50917b969ea None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.509136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2e2e1-653d-413b-ba02-a50917b969ea None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.509871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2e2e1-653d-413b-ba02-a50917b969ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:59.510175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2e2e1-653d-413b-ba02-a50917b969ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.511629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2e2e1-653d-413b-ba02-a50917b969ea None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.524448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 290/577] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:59.524448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2e2e1-653d-413b-ba02-a50917b969ea None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.542376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7a47f-4e40-4b4a-8c17-19a9fa38426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.543042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7a47f-4e40-4b4a-8c17-19a9fa38426d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.543327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7a47f-4e40-4b4a-8c17-19a9fa38426d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.543600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7a47f-4e40-4b4a-8c17-19a9fa38426d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.544306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7a47f-4e40-4b4a-8c17-19a9fa38426d None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:59.544609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7a47f-4e40-4b4a-8c17-19a9fa38426d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.545962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7a47f-4e40-4b4a-8c17-19a9fa38426d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.554584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 288/578] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:59.555425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7a47f-4e40-4b4a-8c17-19a9fa38426d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.624255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2e2e1-653d-413b-ba02-a50917b969ea None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.627225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.660558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accdee-7f6f-41a4-a619-dfe54d1c69c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.661197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accdee-7f6f-41a4-a619-dfe54d1c69c7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.661479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accdee-7f6f-41a4-a619-dfe54d1c69c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.661749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accdee-7f6f-41a4-a619-dfe54d1c69c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.665603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7a47f-4e40-4b4a-8c17-19a9fa38426d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.672095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31accdee-7f6f-41a4-a619-dfe54d1c69c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.672739 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.673697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31accdee-7f6f-41a4-a619-dfe54d1c69c7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-31accdee-7f6f-41a4-a619-dfe54d1c69c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:59.688523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:59.689908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:59.691451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:59.691451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:59.691451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:59.691451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:59.691451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 291/579] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:59.691451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accdee-7f6f-41a4-a619-dfe54d1c69c7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.707709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b915b-3705-458d-888b-a05457492bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.708357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b915b-3705-458d-888b-a05457492bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.708635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b915b-3705-458d-888b-a05457492bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.708909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b915b-3705-458d-888b-a05457492bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.719897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b915b-3705-458d-888b-a05457492bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.721339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b915b-3705-458d-888b-a05457492bb6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-147b915b-3705-458d-888b-a05457492bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:59.736601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:59.737674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:59.738596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:59.738596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:59.738596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:59.738596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:27:59.738596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 289/580] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:59.739135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b915b-3705-458d-888b-a05457492bb6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.794945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accdee-7f6f-41a4-a619-dfe54d1c69c7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.830336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0aaee-7033-4311-9ba3-7b7359c489bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.830336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0aaee-7033-4311-9ba3-7b7359c489bc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.830336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0aaee-7033-4311-9ba3-7b7359c489bc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.831552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0aaee-7033-4311-9ba3-7b7359c489bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.840921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0aaee-7033-4311-9ba3-7b7359c489bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.842273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b915b-3705-458d-888b-a05457492bb6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:27:59.842381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0aaee-7033-4311-9ba3-7b7359c489bc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-62a0aaee-7033-4311-9ba3-7b7359c489bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:27:59.859281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:27:59.860206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:27:59.861053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:27:59.861053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:27:59.861053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:27:59.861053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:27:59.861053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 292/581] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:27:59.861433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0aaee-7033-4311-9ba3-7b7359c489bc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.872260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.878137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d739ecb-1d12-4507-8711-5622da5dcdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:27:59.878759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d739ecb-1d12-4507-8711-5622da5dcdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:27:59.879077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d739ecb-1d12-4507-8711-5622da5dcdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:27:59.879356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d739ecb-1d12-4507-8711-5622da5dcdc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:27:59.880140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d739ecb-1d12-4507-8711-5622da5dcdc3 None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=5dcb9d2fbde74819b3848d050299cfe9) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:27:59.880446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d739ecb-1d12-4507-8711-5622da5dcdc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:27:59.881866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d739ecb-1d12-4507-8711-5622da5dcdc3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:27:59.887247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 290/582] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/role_assignments?user.id=5dcb9d2fbde74819b3848d050299cfe9&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:27:59.888053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d739ecb-1d12-4507-8711-5622da5dcdc3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:27:59.916782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:27:59.993548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0aaee-7033-4311-9ba3-7b7359c489bc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.001821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d739ecb-1d12-4507-8711-5622da5dcdc3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.032882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085626d8-0e07-4145-9356-9fbce6b9cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.033646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085626d8-0e07-4145-9356-9fbce6b9cf80 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.033928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085626d8-0e07-4145-9356-9fbce6b9cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.034214 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085626d8-0e07-4145-9356-9fbce6b9cf80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.042892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28833-a2a9-4371-8da9-4676e3876b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.044273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28833-a2a9-4371-8da9-4676e3876b11 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.044273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28833-a2a9-4371-8da9-4676e3876b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.044273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28833-a2a9-4371-8da9-4676e3876b11 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.044735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f28833-a2a9-4371-8da9-4676e3876b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:00.045041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f28833-a2a9-4371-8da9-4676e3876b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.046404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f28833-a2a9-4371-8da9-4676e3876b11 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.048456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085626d8-0e07-4145-9356-9fbce6b9cf80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.050556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085626d8-0e07-4145-9356-9fbce6b9cf80 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.064087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 291/583] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:00.064087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28833-a2a9-4371-8da9-4676e3876b11 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-085626d8-0e07-4145-9356-9fbce6b9cf80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:00.072590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:00.073646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:00.074733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:00.074733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:00.074733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:00.074733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:00.078714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 293/584] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:00.079432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085626d8-0e07-4145-9356-9fbce6b9cf80 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.140008 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.155449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.176919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28833-a2a9-4371-8da9-4676e3876b11 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.187605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085626d8-0e07-4145-9356-9fbce6b9cf80 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.213612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4b70b-0fef-4fe4-a3fd-eabbb6da7509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.214239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4b70b-0fef-4fe4-a3fd-eabbb6da7509 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.214519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4b70b-0fef-4fe4-a3fd-eabbb6da7509 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.214791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4b70b-0fef-4fe4-a3fd-eabbb6da7509 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.215514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4b70b-0fef-4fe4-a3fd-eabbb6da7509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:00.215810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4b70b-0fef-4fe4-a3fd-eabbb6da7509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.217173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4b70b-0fef-4fe4-a3fd-eabbb6da7509 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.223712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bc966-ac49-419c-bb8e-4f75186df3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.224337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bc966-ac49-419c-bb8e-4f75186df3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.224613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bc966-ac49-419c-bb8e-4f75186df3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.224930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bc966-ac49-419c-bb8e-4f75186df3b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.225769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bc966-ac49-419c-bb8e-4f75186df3b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:00.226074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bc966-ac49-419c-bb8e-4f75186df3b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.227784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bc966-ac49-419c-bb8e-4f75186df3b0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.230526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 292/585] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:00.231446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4b70b-0fef-4fe4-a3fd-eabbb6da7509 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.249449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 294/586] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:00.249449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bc966-ac49-419c-bb8e-4f75186df3b0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.344678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4b70b-0fef-4fe4-a3fd-eabbb6da7509 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.351271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bc966-ac49-419c-bb8e-4f75186df3b0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.373295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.382653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89f6cd-cea0-4614-b6fc-0b71fb3c2ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.383422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89f6cd-cea0-4614-b6fc-0b71fb3c2ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.383708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89f6cd-cea0-4614-b6fc-0b71fb3c2ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.383988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89f6cd-cea0-4614-b6fc-0b71fb3c2ad7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.389549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085a7ba-4d02-4b89-8fca-e71eb7b6fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.390359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085a7ba-4d02-4b89-8fca-e71eb7b6fe8d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.390822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085a7ba-4d02-4b89-8fca-e71eb7b6fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.391058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89f6cd-cea0-4614-b6fc-0b71fb3c2ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.391496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085a7ba-4d02-4b89-8fca-e71eb7b6fe8d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.392421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085a7ba-4d02-4b89-8fca-e71eb7b6fe8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:00.392771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89f6cd-cea0-4614-b6fc-0b71fb3c2ad7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.393177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085a7ba-4d02-4b89-8fca-e71eb7b6fe8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.394812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085a7ba-4d02-4b89-8fca-e71eb7b6fe8d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0d89f6cd-cea0-4614-b6fc-0b71fb3c2ad7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:00.404249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:00.405144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:00.406032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:00.406032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:00.406032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:00.406032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:00.406032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:00.406032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:00.406032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:00.406032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:00.413570 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 295/587] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:00.413570 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085a7ba-4d02-4b89-8fca-e71eb7b6fe8d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.413780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 293/588] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:00.413780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89f6cd-cea0-4614-b6fc-0b71fb3c2ad7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.415335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.521768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085a7ba-4d02-4b89-8fca-e71eb7b6fe8d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.523859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89f6cd-cea0-4614-b6fc-0b71fb3c2ad7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.558746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2f813-88e2-4697-8bbb-ec5816019f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.559427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2f813-88e2-4697-8bbb-ec5816019f94 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.559706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2f813-88e2-4697-8bbb-ec5816019f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.559981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2f813-88e2-4697-8bbb-ec5816019f94 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.560082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b00939-58bb-43ce-8b29-6a33edcf94e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.561088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b00939-58bb-43ce-8b29-6a33edcf94e1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.561545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b00939-58bb-43ce-8b29-6a33edcf94e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.561994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b00939-58bb-43ce-8b29-6a33edcf94e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.568555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2f813-88e2-4697-8bbb-ec5816019f94 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.569950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b00939-58bb-43ce-8b29-6a33edcf94e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.570097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2f813-88e2-4697-8bbb-ec5816019f94 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.571757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b00939-58bb-43ce-8b29-6a33edcf94e1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f7a2f813-88e2-4697-8bbb-ec5816019f94 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:00.582091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:00.583245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:28:00.584472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-32b00939-58bb-43ce-8b29-6a33edcf94e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:00.585288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:00.586272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:00.588177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:00.588177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:00.588177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:00.588177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:00.588177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:00.588177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:00.588177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:00.588177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:00.589282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 296/589] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:00.589282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2f813-88e2-4697-8bbb-ec5816019f94 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.592287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 294/590] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:00.593121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b00939-58bb-43ce-8b29-6a33edcf94e1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.633782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.659014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.707200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2f813-88e2-4697-8bbb-ec5816019f94 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.713723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b00939-58bb-43ce-8b29-6a33edcf94e1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.742077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622f425-761f-4aba-a223-cf0459e0c7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.742702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622f425-761f-4aba-a223-cf0459e0c7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.742973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622f425-761f-4aba-a223-cf0459e0c7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.743270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622f425-761f-4aba-a223-cf0459e0c7b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.744017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622f425-761f-4aba-a223-cf0459e0c7b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:00.744322 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622f425-761f-4aba-a223-cf0459e0c7b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.745891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622f425-761f-4aba-a223-cf0459e0c7b7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.754301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53eb6-4ec4-4675-a3cc-14e865dc3f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.754946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53eb6-4ec4-4675-a3cc-14e865dc3f55 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.755273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53eb6-4ec4-4675-a3cc-14e865dc3f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.755548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53eb6-4ec4-4675-a3cc-14e865dc3f55 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.765849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 297/591] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:00.765849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622f425-761f-4aba-a223-cf0459e0c7b7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.766142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53eb6-4ec4-4675-a3cc-14e865dc3f55 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.766142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53eb6-4ec4-4675-a3cc-14e865dc3f55 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-17f53eb6-4ec4-4675-a3cc-14e865dc3f55 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:00.780286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:00.781399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 295/592] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:00.783145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53eb6-4ec4-4675-a3cc-14e865dc3f55 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.874610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.878004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622f425-761f-4aba-a223-cf0459e0c7b7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.890649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53eb6-4ec4-4675-a3cc-14e865dc3f55 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:00.915496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:00.915822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13d8b-cf2c-4b64-9b8c-aca1d89a7ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.916438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13d8b-cf2c-4b64-9b8c-aca1d89a7ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.916716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13d8b-cf2c-4b64-9b8c-aca1d89a7ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.917004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13d8b-cf2c-4b64-9b8c-aca1d89a7ec4 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.917785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13d8b-cf2c-4b64-9b8c-aca1d89a7ec4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:00.918106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13d8b-cf2c-4b64-9b8c-aca1d89a7ec4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.919557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13d8b-cf2c-4b64-9b8c-aca1d89a7ec4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.929728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b3ea3-b33b-4301-8108-6755c75a0703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:00.930357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b3ea3-b33b-4301-8108-6755c75a0703 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:00.930641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b3ea3-b33b-4301-8108-6755c75a0703 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:00.930918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b3ea3-b33b-4301-8108-6755c75a0703 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:00.931715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b3ea3-b33b-4301-8108-6755c75a0703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:00.932021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b3ea3-b33b-4301-8108-6755c75a0703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:00.933453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b3ea3-b33b-4301-8108-6755c75a0703 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:00.943400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 298/593] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:00.943400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13d8b-cf2c-4b64-9b8c-aca1d89a7ec4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:00.947837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 296/594] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:00.948889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b3ea3-b33b-4301-8108-6755c75a0703 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:01.054799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13d8b-cf2c-4b64-9b8c-aca1d89a7ec4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:01.067249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b3ea3-b33b-4301-8108-6755c75a0703 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:01.092918 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c746-11c0-4894-b8fb-d64cae2423bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:01.093583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c746-11c0-4894-b8fb-d64cae2423bf None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:01.093876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c746-11c0-4894-b8fb-d64cae2423bf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:01.094216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c746-11c0-4894-b8fb-d64cae2423bf None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/bd26e2ac2578438e854d51d8eed26463/roles/e1668813c1fa4ab5af30b933fa7ee73e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:01.106358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3d77c-f705-4474-a095-1689ae4705e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:01.106976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3d77c-f705-4474-a095-1689ae4705e0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:01.107343 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3d77c-f705-4474-a095-1689ae4705e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:01.107612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3d77c-f705-4474-a095-1689ae4705e0 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:01.108395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3d77c-f705-4474-a095-1689ae4705e0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:01.108698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3d77c-f705-4474-a095-1689ae4705e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:01.109841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9c746-11c0-4894-b8fb-d64cae2423bf None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=bd26e2ac2578438e854d51d8eed26463, role_id=e1668813c1fa4ab5af30b933fa7ee73e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:01.110147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3d77c-f705-4474-a095-1689ae4705e0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:01.111307 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9c746-11c0-4894-b8fb-d64cae2423bf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:01.124716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 299/595] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:00 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/bd26e2ac2578438e854d51d8eed26463/roles/e1668813c1fa4ab5af30b933fa7ee73e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:01.135313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c746-11c0-4894-b8fb-d64cae2423bf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:01.135423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 297/596] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Aug 4 04:28:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:01.135423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3d77c-f705-4474-a095-1689ae4705e0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:01.169175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:01.189990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:01.272712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3d77c-f705-4474-a095-1689ae4705e0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:01.277036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c746-11c0-4894-b8fb-d64cae2423bf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:01.317358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd240-8710-4c3d-8def-1c78fb0cd3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:01.318042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd240-8710-4c3d-8def-1c78fb0cd3a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:01.318323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd240-8710-4c3d-8def-1c78fb0cd3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:01.318651 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd240-8710-4c3d-8def-1c78fb0cd3a1 None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/955c6cb8893c473fadd028b12bbea69d/roles/e1668813c1fa4ab5af30b933fa7ee73e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:01.322101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc088-cf03-47bb-9e03-f33dbba1b996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:01.322577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc088-cf03-47bb-9e03-f33dbba1b996 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:01.322955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc088-cf03-47bb-9e03-f33dbba1b996 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:01.323349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc088-cf03-47bb-9e03-f33dbba1b996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:01.335601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cd240-8710-4c3d-8def-1c78fb0cd3a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=955c6cb8893c473fadd028b12bbea69d, role_id=e1668813c1fa4ab5af30b933fa7ee73e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:01.337041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cd240-8710-4c3d-8def-1c78fb0cd3a1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:01.338558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfc088-cf03-47bb-9e03-f33dbba1b996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:01.340110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfc088-cf03-47bb-9e03-f33dbba1b996 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:01.356608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 298/597] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:01 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/955c6cb8893c473fadd028b12bbea69d/roles/e1668813c1fa4ab5af30b933fa7ee73e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:01.357506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd240-8710-4c3d-8def-1c78fb0cd3a1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-60bfc088-cf03-47bb-9e03-f33dbba1b996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:01.362743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:01.363683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:01.364554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:01.364554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:01.364554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:01.364554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:01.364554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 300/598] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:01.370671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc088-cf03-47bb-9e03-f33dbba1b996 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:01.481108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:01.565187 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:01.568033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc088-cf03-47bb-9e03-f33dbba1b996 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:01.583437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd240-8710-4c3d-8def-1c78fb0cd3a1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:01.613888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349684a-adb0-4f9e-9d30-ee7f0aa4564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:01.614938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349684a-adb0-4f9e-9d30-ee7f0aa4564e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:01.615606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349684a-adb0-4f9e-9d30-ee7f0aa4564e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:01.616311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349684a-adb0-4f9e-9d30-ee7f0aa4564e None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:01.617224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349684a-adb0-4f9e-9d30-ee7f0aa4564e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:01.617791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349684a-adb0-4f9e-9d30-ee7f0aa4564e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:01.619601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349684a-adb0-4f9e-9d30-ee7f0aa4564e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:01.621971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96581b0-60df-4da2-993d-089cc7851afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:01.623024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96581b0-60df-4da2-993d-089cc7851afb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:01.623153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96581b0-60df-4da2-993d-089cc7851afb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:01.623471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96581b0-60df-4da2-993d-089cc7851afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:01.634877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 301/599] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:01.635074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96581b0-60df-4da2-993d-089cc7851afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:01.636534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96581b0-60df-4da2-993d-089cc7851afb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:01.640269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349684a-adb0-4f9e-9d30-ee7f0aa4564e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d96581b0-60df-4da2-993d-089cc7851afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:01.655734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:01.656861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:01.657920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:01.657920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:01.657920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:01.657920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:01.660314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 299/600] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:01.668656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96581b0-60df-4da2-993d-089cc7851afb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:01.795868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96581b0-60df-4da2-993d-089cc7851afb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:01.836226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42ae0-5290-499d-bb31-c6163e222de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:01.837071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42ae0-5290-499d-bb31-c6163e222de1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:01.837451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42ae0-5290-499d-bb31-c6163e222de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:01.837825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42ae0-5290-499d-bb31-c6163e222de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:01.838593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349684a-adb0-4f9e-9d30-ee7f0aa4564e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:01.838712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de42ae0-5290-499d-bb31-c6163e222de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:01.839136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de42ae0-5290-499d-bb31-c6163e222de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:01.840786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de42ae0-5290-499d-bb31-c6163e222de1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:01.857033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 300/601] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:01.863779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:01.865057 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42ae0-5290-499d-bb31-c6163e222de1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:01.872314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:01.897420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cd7e6-9863-4a77-b295-2857539cdc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:01.898071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cd7e6-9863-4a77-b295-2857539cdc94 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:01.898353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cd7e6-9863-4a77-b295-2857539cdc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:01.898627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cd7e6-9863-4a77-b295-2857539cdc94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:01.909971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cd7e6-9863-4a77-b295-2857539cdc94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:01.911586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cd7e6-9863-4a77-b295-2857539cdc94 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-172cd7e6-9863-4a77-b295-2857539cdc94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:01.925137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:01.926215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:01.927394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:01.927394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:01.927394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:01.927394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:01.927394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:01.927394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:01.927394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:01.927394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:01.927394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 302/602] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:01.932052 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cd7e6-9863-4a77-b295-2857539cdc94 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:02.028616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42ae0-5290-499d-bb31-c6163e222de1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:02.060175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cd7e6-9863-4a77-b295-2857539cdc94 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:02.066592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ef3aa-4e84-4346-af71-52826039f9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:02.067441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ef3aa-4e84-4346-af71-52826039f9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.067786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ef3aa-4e84-4346-af71-52826039f9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.068131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ef3aa-4e84-4346-af71-52826039f9d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.075576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ef3aa-4e84-4346-af71-52826039f9d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:02.077285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ef3aa-4e84-4346-af71-52826039f9d8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0d2ef3aa-4e84-4346-af71-52826039f9d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:02.093714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:02.095352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:02.096422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:02.096422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:02.096422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:02.096422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:02.096422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:02.096422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:02.096422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:02.096422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:02.098394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 301/603] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:02.101834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2fad8-c51d-4906-bd81-d75a33c76762 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.101834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2fad8-c51d-4906-bd81-d75a33c76762 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.101834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2fad8-c51d-4906-bd81-d75a33c76762 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.102566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83e48b-7a02-49a8-b23e-fd9cd3e8f444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:02.103215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83e48b-7a02-49a8-b23e-fd9cd3e8f444 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.103497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83e48b-7a02-49a8-b23e-fd9cd3e8f444 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.103769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83e48b-7a02-49a8-b23e-fd9cd3e8f444 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.104520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83e48b-7a02-49a8-b23e-fd9cd3e8f444 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:02.104881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 302/604] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:02.104979 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83e48b-7a02-49a8-b23e-fd9cd3e8f444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:02.105641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2fad8-c51d-4906-bd81-d75a33c76762 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:02.106436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83e48b-7a02-49a8-b23e-fd9cd3e8f444 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:02.122352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 303/605] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:02.123694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2269-a5b5-46ea-9900-15727b22f1a6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.123982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2269-a5b5-46ea-9900-15727b22f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.124257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2269-a5b5-46ea-9900-15727b22f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.143459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-558d2269-a5b5-46ea-9900-15727b22f1a6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:02.144972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-558d2269-a5b5-46ea-9900-15727b22f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:02.182380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:02.187255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:02.229438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 304/606] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:02.230734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2269-a5b5-46ea-9900-15727b22f1a6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:02.234244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2fad8-c51d-4906-bd81-d75a33c76762 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:02.275345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddd872-7173-4af0-9cf2-d236e47474a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:02.276898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddd872-7173-4af0-9cf2-d236e47474a4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.277494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddd872-7173-4af0-9cf2-d236e47474a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.278869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddd872-7173-4af0-9cf2-d236e47474a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.280146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddd872-7173-4af0-9cf2-d236e47474a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:02.281195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddd872-7173-4af0-9cf2-d236e47474a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:02.283995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddd872-7173-4af0-9cf2-d236e47474a4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:02.299100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 303/607] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:02.300322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddd872-7173-4af0-9cf2-d236e47474a4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:02.371915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2269-a5b5-46ea-9900-15727b22f1a6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:02.409915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00733f-1621-4263-a51b-753d304b177e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:02.410749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00733f-1621-4263-a51b-753d304b177e None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.411159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00733f-1621-4263-a51b-753d304b177e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.411519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00733f-1621-4263-a51b-753d304b177e None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/7a7ad7efdc2849ca98386decbfd77879/roles/e1668813c1fa4ab5af30b933fa7ee73e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.416250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddd872-7173-4af0-9cf2-d236e47474a4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:02.427296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00733f-1621-4263-a51b-753d304b177e None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=7a7ad7efdc2849ca98386decbfd77879, role_id=e1668813c1fa4ab5af30b933fa7ee73e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:02.428845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00733f-1621-4263-a51b-753d304b177e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:02.443896 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:02.452607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 305/608] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:02 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/7a7ad7efdc2849ca98386decbfd77879/roles/e1668813c1fa4ab5af30b933fa7ee73e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:02.454402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00733f-1621-4263-a51b-753d304b177e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:02.459537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81936bb6-1f7a-4edc-bb2a-8b7ab8ae8593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:02.460560 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81936bb6-1f7a-4edc-bb2a-8b7ab8ae8593 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.461078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81936bb6-1f7a-4edc-bb2a-8b7ab8ae8593 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.461549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81936bb6-1f7a-4edc-bb2a-8b7ab8ae8593 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.485233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81936bb6-1f7a-4edc-bb2a-8b7ab8ae8593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-81936bb6-1f7a-4edc-bb2a-8b7ab8ae8593 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:02.492905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:02.493895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:02.494837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:02.503906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 304/609] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:02.506599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81936bb6-1f7a-4edc-bb2a-8b7ab8ae8593 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:02.526821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:02.673336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00733f-1621-4263-a51b-753d304b177e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:02.691335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81936bb6-1f7a-4edc-bb2a-8b7ab8ae8593 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:02.709760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8584-a710-4a9a-b500-6b7ef408bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:02.710430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8584-a710-4a9a-b500-6b7ef408bf7e None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.710702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8584-a710-4a9a-b500-6b7ef408bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.710977 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8584-a710-4a9a-b500-6b7ef408bf7e None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/c426cc367a1843d38978d3b8e636276e/roles/e1668813c1fa4ab5af30b933fa7ee73e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.727655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed8584-a710-4a9a-b500-6b7ef408bf7e None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=c426cc367a1843d38978d3b8e636276e, role_id=e1668813c1fa4ab5af30b933fa7ee73e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:02.729091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed8584-a710-4a9a-b500-6b7ef408bf7e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:02.729710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c65c-7c9e-4ab9-93a5-61a2d046ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:02.730686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c65c-7c9e-4ab9-93a5-61a2d046ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.731189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c65c-7c9e-4ab9-93a5-61a2d046ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.731633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482c65c-7c9e-4ab9-93a5-61a2d046ddc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.735576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c65c-7c9e-4ab9-93a5-61a2d046ddc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:02.736229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c65c-7c9e-4ab9-93a5-61a2d046ddc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:02.737801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482c65c-7c9e-4ab9-93a5-61a2d046ddc2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:02.746056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 306/610] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:02 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/c426cc367a1843d38978d3b8e636276e/roles/e1668813c1fa4ab5af30b933fa7ee73e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:02.747557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 305/611] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:28:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:02.757651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8584-a710-4a9a-b500-6b7ef408bf7e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:02.843864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:02.888807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8584-a710-4a9a-b500-6b7ef408bf7e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:02.943082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b10af-5b4c-40e1-8e12-48ec235a9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:02.944142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b10af-5b4c-40e1-8e12-48ec235a9142 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:02.944431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b10af-5b4c-40e1-8e12-48ec235a9142 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:02.944714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b10af-5b4c-40e1-8e12-48ec235a9142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:02.956278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b10af-5b4c-40e1-8e12-48ec235a9142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:02.957813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b10af-5b4c-40e1-8e12-48ec235a9142 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-307b10af-5b4c-40e1-8e12-48ec235a9142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:02.974950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:02.976051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:02.977133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:02.977133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:02.977133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:02.977133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:02.978242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 307/612] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:02.983858 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c65c-7c9e-4ab9-93a5-61a2d046ddc2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:03.033905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:03.091179 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482c65c-7c9e-4ab9-93a5-61a2d046ddc2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:03.126399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5816b-5d61-4893-b2e7-bf1a292495f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:03.127065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5816b-5d61-4893-b2e7-bf1a292495f9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.127325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5816b-5d61-4893-b2e7-bf1a292495f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.127597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5816b-5d61-4893-b2e7-bf1a292495f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.128349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5816b-5d61-4893-b2e7-bf1a292495f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:03.128653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5816b-5d61-4893-b2e7-bf1a292495f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:03.130067 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5816b-5d61-4893-b2e7-bf1a292495f9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:03.144124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 306/613] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:03.149835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b10af-5b4c-40e1-8e12-48ec235a9142 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:03.255625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b10af-5b4c-40e1-8e12-48ec235a9142 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:03.284316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:03.293527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c365091-a761-44c8-a9a0-1c93db344f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:03.294175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c365091-a761-44c8-a9a0-1c93db344f16 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.294457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c365091-a761-44c8-a9a0-1c93db344f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.294733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c365091-a761-44c8-a9a0-1c93db344f16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.304445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c365091-a761-44c8-a9a0-1c93db344f16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:03.305873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c365091-a761-44c8-a9a0-1c93db344f16 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-2c365091-a761-44c8-a9a0-1c93db344f16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:03.318175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:03.319161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:03.320495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 308/614] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:03.328160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5816b-5d61-4893-b2e7-bf1a292495f9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:03.424661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0fba4-e2d9-4545-bc07-924d0d275595 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.424995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0fba4-e2d9-4545-bc07-924d0d275595 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.425209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0fba4-e2d9-4545-bc07-924d0d275595 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.426673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 309/615] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:03.431799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39cff3-6169-47db-8506-437f6d84f3a3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.432084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39cff3-6169-47db-8506-437f6d84f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.432358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39cff3-6169-47db-8506-437f6d84f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.468585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-aa39cff3-6169-47db-8506-437f6d84f3a3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:03.469830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aa39cff3-6169-47db-8506-437f6d84f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:03.484557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5816b-5d61-4893-b2e7-bf1a292495f9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:03.499334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:03.555285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82438f9-79d2-4edf-97cf-05ba9e4f3ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:03.555834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82438f9-79d2-4edf-97cf-05ba9e4f3ccb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.556115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82438f9-79d2-4edf-97cf-05ba9e4f3ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.556388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82438f9-79d2-4edf-97cf-05ba9e4f3ccb None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.557196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82438f9-79d2-4edf-97cf-05ba9e4f3ccb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:03.557500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82438f9-79d2-4edf-97cf-05ba9e4f3ccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:03.558924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82438f9-79d2-4edf-97cf-05ba9e4f3ccb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:03.592032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 307/616] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Aug 4 04:28:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:03.597735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82438f9-79d2-4edf-97cf-05ba9e4f3ccb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:03.600648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 310/617] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 04 04:28:03.631711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39cff3-6169-47db-8506-437f6d84f3a3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:03.713105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82438f9-79d2-4edf-97cf-05ba9e4f3ccb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:03.755870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4155fa-8eac-47de-bf84-0321ca4878cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:03.756199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4155fa-8eac-47de-bf84-0321ca4878cb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.759028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4155fa-8eac-47de-bf84-0321ca4878cb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.759028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4155fa-8eac-47de-bf84-0321ca4878cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.768259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4155fa-8eac-47de-bf84-0321ca4878cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:03.769824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4155fa-8eac-47de-bf84-0321ca4878cb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fb4155fa-8eac-47de-bf84-0321ca4878cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:03.787655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:03.788568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:03.789448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:03.789448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:03.789448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:03.789448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:03.789448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 308/618] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:03.790397 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9cbfe-9d7a-4941-ace5-995e5c293840 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.790682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9cbfe-9d7a-4941-ace5-995e5c293840 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.791020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9cbfe-9d7a-4941-ace5-995e5c293840 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.792535 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 309/619] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:03.797984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9cbfe-9d7a-4941-ace5-995e5c293840 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:03.798733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39cff3-6169-47db-8506-437f6d84f3a3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:03.815966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:03.823348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:03.841166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834b31d-4097-43c2-9580-648dc798fad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:03.842017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834b31d-4097-43c2-9580-648dc798fad1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.842552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834b31d-4097-43c2-9580-648dc798fad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.842968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834b31d-4097-43c2-9580-648dc798fad1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.858214 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834b31d-4097-43c2-9580-648dc798fad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4834b31d-4097-43c2-9580-648dc798fad1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:03.867707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:03.868889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:03.870016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:03.872855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 311/620] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:03.875761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cf559-9f6c-4214-a0da-fe87cc4227c6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.876203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cf559-9f6c-4214-a0da-fe87cc4227c6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.876634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cf559-9f6c-4214-a0da-fe87cc4227c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.903914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9e0cf559-9f6c-4214-a0da-fe87cc4227c6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:03.905512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9e0cf559-9f6c-4214-a0da-fe87cc4227c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:03.917005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9cbfe-9d7a-4941-ace5-995e5c293840 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:03.955658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b4a89-af9d-495c-92b0-59aea3b176eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:03.956284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4a89-af9d-495c-92b0-59aea3b176eb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:03.956775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4a89-af9d-495c-92b0-59aea3b176eb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:03.956916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4a89-af9d-495c-92b0-59aea3b176eb None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:03.957591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b4a89-af9d-495c-92b0-59aea3b176eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:03.957946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b4a89-af9d-495c-92b0-59aea3b176eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:03.959452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b4a89-af9d-495c-92b0-59aea3b176eb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:03.972260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 310/621] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:03.973385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b4a89-af9d-495c-92b0-59aea3b176eb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:03.988497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 312/622] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:03.989737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cf559-9f6c-4214-a0da-fe87cc4227c6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:04.078281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:04.105528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b4a89-af9d-495c-92b0-59aea3b176eb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:04.116104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cf559-9f6c-4214-a0da-fe87cc4227c6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:04.131361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:04.142766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2bb08-5266-4f13-82e3-3df285db73e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:04.143681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2bb08-5266-4f13-82e3-3df285db73e3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:04.144162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2bb08-5266-4f13-82e3-3df285db73e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:04.144631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2bb08-5266-4f13-82e3-3df285db73e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:04.145559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2bb08-5266-4f13-82e3-3df285db73e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:04.146058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2bb08-5266-4f13-82e3-3df285db73e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:04.147704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2bb08-5266-4f13-82e3-3df285db73e3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:04.150960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e38f42-a55a-4b9e-b788-7b87fbf61772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:04.151666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e38f42-a55a-4b9e-b788-7b87fbf61772 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:04.151913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e38f42-a55a-4b9e-b788-7b87fbf61772 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:04.152186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e38f42-a55a-4b9e-b788-7b87fbf61772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:04.163115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e38f42-a55a-4b9e-b788-7b87fbf61772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:04.163115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e38f42-a55a-4b9e-b788-7b87fbf61772 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:04.163493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 311/623] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:28:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:04.164575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2bb08-5266-4f13-82e3-3df285db73e3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-12e38f42-a55a-4b9e-b788-7b87fbf61772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:04.173834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:04.174722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:04.175635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:04.175635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:04.175635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:04.175635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:04.175635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:04.175635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:04.175635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:04.175635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:04.180182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 313/624] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:04.180655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e38f42-a55a-4b9e-b788-7b87fbf61772 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:04.283108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2bb08-5266-4f13-82e3-3df285db73e3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:04.295294 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e38f42-a55a-4b9e-b788-7b87fbf61772 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:04.331053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96defa9f-c8ad-4bf1-add3-af8d2acd271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:04.332091 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96defa9f-c8ad-4bf1-add3-af8d2acd271d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:04.332524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96defa9f-c8ad-4bf1-add3-af8d2acd271d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:04.333273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96defa9f-c8ad-4bf1-add3-af8d2acd271d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:04.337268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:04.341355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f0bf2-e540-470e-b2f7-e69257149ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:04.342143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f0bf2-e540-470e-b2f7-e69257149ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:04.342688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f0bf2-e540-470e-b2f7-e69257149ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:04.343101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f0bf2-e540-470e-b2f7-e69257149ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:04.349010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96defa9f-c8ad-4bf1-add3-af8d2acd271d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-96defa9f-c8ad-4bf1-add3-af8d2acd271d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:04.355895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:04.357008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:04.358059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:04.358957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f0bf2-e540-470e-b2f7-e69257149ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:04.365461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f0bf2-e540-470e-b2f7-e69257149ad6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:04.365595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 312/625] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:04.365595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96defa9f-c8ad-4bf1-add3-af8d2acd271d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-493f0bf2-e540-470e-b2f7-e69257149ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:04.380269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:04.381178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:04.382061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:04.382061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:04.382061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:04.382061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:04.386212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 314/626] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:04.387133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f0bf2-e540-470e-b2f7-e69257149ad6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:04.409747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:04.485549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96defa9f-c8ad-4bf1-add3-af8d2acd271d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:04.515289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f0bf2-e540-470e-b2f7-e69257149ad6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:04.522285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3fd14-b1be-4b47-83b5-556db0be02b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:04.523055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3fd14-b1be-4b47-83b5-556db0be02b7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:04.523460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3fd14-b1be-4b47-83b5-556db0be02b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:04.523830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3fd14-b1be-4b47-83b5-556db0be02b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:04.524876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3fd14-b1be-4b47-83b5-556db0be02b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:04.525065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3fd14-b1be-4b47-83b5-556db0be02b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:04.526673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3fd14-b1be-4b47-83b5-556db0be02b7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:04.539505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 313/627] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:04.544460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3fd14-b1be-4b47-83b5-556db0be02b7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:04.569762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5836e84-95b6-4af0-95f1-fa7e04294713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:04.570861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5836e84-95b6-4af0-95f1-fa7e04294713 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:04.571369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5836e84-95b6-4af0-95f1-fa7e04294713 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:04.572019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5836e84-95b6-4af0-95f1-fa7e04294713 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:04.573329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5836e84-95b6-4af0-95f1-fa7e04294713 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:04.574073 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5836e84-95b6-4af0-95f1-fa7e04294713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:04.576337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5836e84-95b6-4af0-95f1-fa7e04294713 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:04.592591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 315/628] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:04.592591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5836e84-95b6-4af0-95f1-fa7e04294713 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:04.620794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:04.680888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3fd14-b1be-4b47-83b5-556db0be02b7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:04.682633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:04.708801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5836e84-95b6-4af0-95f1-fa7e04294713 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:04.722011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd71d3a-fb0b-4c13-9f5f-a93f368e2233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:04.723068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd71d3a-fb0b-4c13-9f5f-a93f368e2233 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:04.723630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd71d3a-fb0b-4c13-9f5f-a93f368e2233 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:04.724084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd71d3a-fb0b-4c13-9f5f-a93f368e2233 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:04.725016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd71d3a-fb0b-4c13-9f5f-a93f368e2233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:04.725546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd71d3a-fb0b-4c13-9f5f-a93f368e2233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:04.727325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd71d3a-fb0b-4c13-9f5f-a93f368e2233 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:04.741193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 314/629] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:04.742456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd71d3a-fb0b-4c13-9f5f-a93f368e2233 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:04.750046 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61def99a-3704-4b1d-8fbd-6999097687bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:04.751532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61def99a-3704-4b1d-8fbd-6999097687bb None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:04.751879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61def99a-3704-4b1d-8fbd-6999097687bb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:04.752222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61def99a-3704-4b1d-8fbd-6999097687bb None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/5dcb9d2fbde74819b3848d050299cfe9/roles/e1668813c1fa4ab5af30b933fa7ee73e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:04.783997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61def99a-3704-4b1d-8fbd-6999097687bb None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=5dcb9d2fbde74819b3848d050299cfe9, role_id=e1668813c1fa4ab5af30b933fa7ee73e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:04.785775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61def99a-3704-4b1d-8fbd-6999097687bb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:04.809324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 316/630] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:04 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/5dcb9d2fbde74819b3848d050299cfe9/roles/e1668813c1fa4ab5af30b933fa7ee73e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:04.810865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61def99a-3704-4b1d-8fbd-6999097687bb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:04.988189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd71d3a-fb0b-4c13-9f5f-a93f368e2233 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:05.032435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:05.065767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6625021-baf7-4378-832c-f491bfbd7e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:05.066717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625021-baf7-4378-832c-f491bfbd7e20 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.067298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625021-baf7-4378-832c-f491bfbd7e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.067407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625021-baf7-4378-832c-f491bfbd7e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.077118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61def99a-3704-4b1d-8fbd-6999097687bb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:05.081909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6625021-baf7-4378-832c-f491bfbd7e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:05.083488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6625021-baf7-4378-832c-f491bfbd7e20 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b6625021-baf7-4378-832c-f491bfbd7e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:05.099907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:05.100827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:05.101736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:05.101736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:05.101736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:05.101736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:05.106455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 315/631] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:05.108456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f60cb-bd45-468d-9ff8-4dad733b1dcf None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.108456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f60cb-bd45-468d-9ff8-4dad733b1dcf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.108783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f60cb-bd45-468d-9ff8-4dad733b1dcf None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.112785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 316/632] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:05.113644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f60cb-bd45-468d-9ff8-4dad733b1dcf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:05.121167 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:05.132242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d606a2c-0e7c-4430-ac05-9dd0ea7a243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:05.132887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606a2c-0e7c-4430-ac05-9dd0ea7a243e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.133340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606a2c-0e7c-4430-ac05-9dd0ea7a243e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.133625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606a2c-0e7c-4430-ac05-9dd0ea7a243e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.143265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d606a2c-0e7c-4430-ac05-9dd0ea7a243e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:05.144769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d606a2c-0e7c-4430-ac05-9dd0ea7a243e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3d606a2c-0e7c-4430-ac05-9dd0ea7a243e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:05.171738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:05.173091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:05.174022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:05.183459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 317/633] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Aug 4 04:28:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:05.189961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d376a-65a6-4456-956c-b5effaa64cfb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.189961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d376a-65a6-4456-956c-b5effaa64cfb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.189961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d376a-65a6-4456-956c-b5effaa64cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.231582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7b9d376a-65a6-4456-956c-b5effaa64cfb None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:05.232789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7b9d376a-65a6-4456-956c-b5effaa64cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:05.237471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f60cb-bd45-468d-9ff8-4dad733b1dcf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:05.278250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6e3b1-0be3-4b0c-b37b-9c5c55f7ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:05.278597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6e3b1-0be3-4b0c-b37b-9c5c55f7ef99 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.278879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6e3b1-0be3-4b0c-b37b-9c5c55f7ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.279196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6e3b1-0be3-4b0c-b37b-9c5c55f7ef99 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.279891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6e3b1-0be3-4b0c-b37b-9c5c55f7ef99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:05.280196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6e3b1-0be3-4b0c-b37b-9c5c55f7ef99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:05.282236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6e3b1-0be3-4b0c-b37b-9c5c55f7ef99 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:05.299146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 317/634] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:05.300247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6e3b1-0be3-4b0c-b37b-9c5c55f7ef99 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:05.328205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:05.339307 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 318/635] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:05.340698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89fa7a-e11e-46b8-85e3-ab692418f728 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.351083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89fa7a-e11e-46b8-85e3-ab692418f728 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.351083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89fa7a-e11e-46b8-85e3-ab692418f728 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.351083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 319/636] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:05.351083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89fa7a-e11e-46b8-85e3-ab692418f728 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:05.417731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6e3b1-0be3-4b0c-b37b-9c5c55f7ef99 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:05.453662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996479db-c3c4-4adf-b196-3e410a0c0c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:05.454659 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996479db-c3c4-4adf-b196-3e410a0c0c55 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.454889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996479db-c3c4-4adf-b196-3e410a0c0c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.455367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996479db-c3c4-4adf-b196-3e410a0c0c55 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.455842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996479db-c3c4-4adf-b196-3e410a0c0c55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:05.456138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996479db-c3c4-4adf-b196-3e410a0c0c55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:05.457640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996479db-c3c4-4adf-b196-3e410a0c0c55 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:05.467626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89fa7a-e11e-46b8-85e3-ab692418f728 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:05.479456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 318/637] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Aug 4 04:28:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:05.479456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70df1c-2cf1-4faa-955c-248ad29b13cb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.479456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70df1c-2cf1-4faa-955c-248ad29b13cb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.479456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70df1c-2cf1-4faa-955c-248ad29b13cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.487516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:05.500171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bb70df1c-2cf1-4faa-955c-248ad29b13cb None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:05.501537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bb70df1c-2cf1-4faa-955c-248ad29b13cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:05.511164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded85f5-c596-4873-8d3f-71484dc7c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:05.511804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded85f5-c596-4873-8d3f-71484dc7c52a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.512084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded85f5-c596-4873-8d3f-71484dc7c52a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.512353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded85f5-c596-4873-8d3f-71484dc7c52a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.520594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded85f5-c596-4873-8d3f-71484dc7c52a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:05.522016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded85f5-c596-4873-8d3f-71484dc7c52a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5ded85f5-c596-4873-8d3f-71484dc7c52a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:05.534623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:05.535648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:05.536604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 320/638] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:05.537221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded85f5-c596-4873-8d3f-71484dc7c52a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:05.579681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 319/639] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:05.580532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70df1c-2cf1-4faa-955c-248ad29b13cb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:05.615283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:05.652158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded85f5-c596-4873-8d3f-71484dc7c52a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:05.690502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aea02a-f036-457d-89f8-706a88ef454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:05.691178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aea02a-f036-457d-89f8-706a88ef454b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.691460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aea02a-f036-457d-89f8-706a88ef454b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.691731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aea02a-f036-457d-89f8-706a88ef454b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.702251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aea02a-f036-457d-89f8-706a88ef454b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:05.704406 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70df1c-2cf1-4faa-955c-248ad29b13cb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-87aea02a-f036-457d-89f8-706a88ef454b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:05.707689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:05.708649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 321/640] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:05.714619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aea02a-f036-457d-89f8-706a88ef454b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:05.750136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b689dea-ea3e-4be9-82aa-dad9a96504eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:05.751361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b689dea-ea3e-4be9-82aa-dad9a96504eb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.751751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b689dea-ea3e-4be9-82aa-dad9a96504eb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.752021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b689dea-ea3e-4be9-82aa-dad9a96504eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.756239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:05.825936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aea02a-f036-457d-89f8-706a88ef454b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:05.831679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b689dea-ea3e-4be9-82aa-dad9a96504eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:05.833137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b689dea-ea3e-4be9-82aa-dad9a96504eb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:05.850602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:05.864941 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff69b7-cbc9-4635-b206-ca1bfd7f2696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:05.865812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff69b7-cbc9-4635-b206-ca1bfd7f2696 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:05.866240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff69b7-cbc9-4635-b206-ca1bfd7f2696 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:05.866656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff69b7-cbc9-4635-b206-ca1bfd7f2696 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:05.867644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff69b7-cbc9-4635-b206-ca1bfd7f2696 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:05.868098 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff69b7-cbc9-4635-b206-ca1bfd7f2696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:05.869656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff69b7-cbc9-4635-b206-ca1bfd7f2696 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:05.886976 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 322/641] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Aug 4 04:28:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:05.887965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff69b7-cbc9-4635-b206-ca1bfd7f2696 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:05.949796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 320/642] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:05.949796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b689dea-ea3e-4be9-82aa-dad9a96504eb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:05.997351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:06.006136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff69b7-cbc9-4635-b206-ca1bfd7f2696 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.042726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf78ef-59c9-4970-a161-1a6b53c3eef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.043400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf78ef-59c9-4970-a161-1a6b53c3eef2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.043679 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf78ef-59c9-4970-a161-1a6b53c3eef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.043949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf78ef-59c9-4970-a161-1a6b53c3eef2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.056314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf78ef-59c9-4970-a161-1a6b53c3eef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:06.058951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b689dea-ea3e-4be9-82aa-dad9a96504eb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7edf78ef-59c9-4970-a161-1a6b53c3eef2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:06.061289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:06.062286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 323/643] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:06.064033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf78ef-59c9-4970-a161-1a6b53c3eef2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.082207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:06.102721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2730-1068-4cd0-acd2-8c4969896ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.103365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2730-1068-4cd0-acd2-8c4969896ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.103648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2730-1068-4cd0-acd2-8c4969896ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.103921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc2730-1068-4cd0-acd2-8c4969896ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.104816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc2730-1068-4cd0-acd2-8c4969896ad7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:06.105907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc2730-1068-4cd0-acd2-8c4969896ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:06.107303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc2730-1068-4cd0-acd2-8c4969896ad7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:06.122092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 321/644] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:28:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:06.122092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2730-1068-4cd0-acd2-8c4969896ad7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.174751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf78ef-59c9-4970-a161-1a6b53c3eef2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.213796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63e21-5e05-4f69-b528-dffadccf26a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.214781 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63e21-5e05-4f69-b528-dffadccf26a2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.215097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63e21-5e05-4f69-b528-dffadccf26a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.215378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a63e21-5e05-4f69-b528-dffadccf26a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.241542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:06.245114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc2730-1068-4cd0-acd2-8c4969896ad7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.283672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f38d66-b8e6-4270-9254-7e43f778040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.284310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f38d66-b8e6-4270-9254-7e43f778040d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.284591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f38d66-b8e6-4270-9254-7e43f778040d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.284862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f38d66-b8e6-4270-9254-7e43f778040d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.293529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a63e21-5e05-4f69-b528-dffadccf26a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:06.295405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a63e21-5e05-4f69-b528-dffadccf26a2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:06.296373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f38d66-b8e6-4270-9254-7e43f778040d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:06.298081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f38d66-b8e6-4270-9254-7e43f778040d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-70f38d66-b8e6-4270-9254-7e43f778040d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:06.313350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:06.314272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:06.315328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:06.315328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:06.315328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:06.315328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:06.319079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 322/645] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:06.319894 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f38d66-b8e6-4270-9254-7e43f778040d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.359421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:06.414107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 324/646] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:06.415405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63e21-5e05-4f69-b528-dffadccf26a2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.441605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f38d66-b8e6-4270-9254-7e43f778040d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.471692 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:06.481682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97ba41-5136-4196-99a4-27b4a108c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.482384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97ba41-5136-4196-99a4-27b4a108c39a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.482736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97ba41-5136-4196-99a4-27b4a108c39a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.483115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97ba41-5136-4196-99a4-27b4a108c39a None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.483899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97ba41-5136-4196-99a4-27b4a108c39a None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:06.484283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97ba41-5136-4196-99a4-27b4a108c39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:06.486217 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97ba41-5136-4196-99a4-27b4a108c39a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:06.498591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 323/647] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:06.498591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97ba41-5136-4196-99a4-27b4a108c39a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.521712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a63e21-5e05-4f69-b528-dffadccf26a2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.558361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afcedf-e697-4601-9c19-532d89502cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.559021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afcedf-e697-4601-9c19-532d89502cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.559302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afcedf-e697-4601-9c19-532d89502cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.559571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afcedf-e697-4601-9c19-532d89502cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.569661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afcedf-e697-4601-9c19-532d89502cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:06.571111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afcedf-e697-4601-9c19-532d89502cb3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b8afcedf-e697-4601-9c19-532d89502cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:06.587370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:06.588282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:06.589152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:06.589152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:06.589152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:06.589152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:06.589152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 325/648] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:06.589426 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afcedf-e697-4601-9c19-532d89502cb3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.601761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:06.613413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97ba41-5136-4196-99a4-27b4a108c39a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.649793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11491911-6082-43ca-bff1-642ee199272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.650554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491911-6082-43ca-bff1-642ee199272e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.650935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491911-6082-43ca-bff1-642ee199272e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.651334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491911-6082-43ca-bff1-642ee199272e None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.652137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11491911-6082-43ca-bff1-642ee199272e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:06.652540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11491911-6082-43ca-bff1-642ee199272e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:06.654031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11491911-6082-43ca-bff1-642ee199272e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:06.671185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 324/649] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:06.671185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11491911-6082-43ca-bff1-642ee199272e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.713642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afcedf-e697-4601-9c19-532d89502cb3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.722063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:06.760643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c1e84-9ddf-443a-972a-458d4d8e1e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.761395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1e84-9ddf-443a-972a-458d4d8e1e26 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.761801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1e84-9ddf-443a-972a-458d4d8e1e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.762146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1e84-9ddf-443a-972a-458d4d8e1e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.774500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c1e84-9ddf-443a-972a-458d4d8e1e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:06.775527 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11491911-6082-43ca-bff1-642ee199272e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.776217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c1e84-9ddf-443a-972a-458d4d8e1e26 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-231c1e84-9ddf-443a-972a-458d4d8e1e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:06.792774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:06.793885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:06.795030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:06.795030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:06.795030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:06.795030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:06.795880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 326/650] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:06.796585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c1e84-9ddf-443a-972a-458d4d8e1e26 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.819904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87206eef-5503-40f1-85df-f875a733a6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.820550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206eef-5503-40f1-85df-f875a733a6ae None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.820827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206eef-5503-40f1-85df-f875a733a6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.821095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206eef-5503-40f1-85df-f875a733a6ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.831250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87206eef-5503-40f1-85df-f875a733a6ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:06.832682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87206eef-5503-40f1-85df-f875a733a6ae None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-87206eef-5503-40f1-85df-f875a733a6ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:06.847926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:06.850032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:06.851367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:06.851367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:06.851367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:06.851367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:06.851367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 325/651] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:06.851367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87206eef-5503-40f1-85df-f875a733a6ae None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.856594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:06.912840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c1e84-9ddf-443a-972a-458d4d8e1e26 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.948110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fbbf6-38c5-47ba-a9c1-d07cc0a679d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:06.948728 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fbbf6-38c5-47ba-a9c1-d07cc0a679d6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:06.949005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fbbf6-38c5-47ba-a9c1-d07cc0a679d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:06.949276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fbbf6-38c5-47ba-a9c1-d07cc0a679d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:06.949960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fbbf6-38c5-47ba-a9c1-d07cc0a679d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:06.950261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fbbf6-38c5-47ba-a9c1-d07cc0a679d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:06.951653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fbbf6-38c5-47ba-a9c1-d07cc0a679d6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:06.964658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 327/652] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:06.965036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87206eef-5503-40f1-85df-f875a733a6ae None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:06.965470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fbbf6-38c5-47ba-a9c1-d07cc0a679d6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:06.989374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.005369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5037e-5ad3-4941-9157-d60961bcdaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.006015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5037e-5ad3-4941-9157-d60961bcdaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.006294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5037e-5ad3-4941-9157-d60961bcdaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.006569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5037e-5ad3-4941-9157-d60961bcdaa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.013479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5037e-5ad3-4941-9157-d60961bcdaa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.014911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5037e-5ad3-4941-9157-d60961bcdaa9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-72e5037e-5ad3-4941-9157-d60961bcdaa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:07.027314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:07.028192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:07.029132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:07.029132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:07.029132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:07.029132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:07.029132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:07.029132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:07.029132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:07.029132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:07.029132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 326/653] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:07.030039 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5037e-5ad3-4941-9157-d60961bcdaa9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.085621 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fbbf6-38c5-47ba-a9c1-d07cc0a679d6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.096394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.121182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb60d2d-c061-4748-93b4-50b327ef4679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.121784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb60d2d-c061-4748-93b4-50b327ef4679 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.122072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb60d2d-c061-4748-93b4-50b327ef4679 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.122348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb60d2d-c061-4748-93b4-50b327ef4679 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.123075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb60d2d-c061-4748-93b4-50b327ef4679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:07.123382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb60d2d-c061-4748-93b4-50b327ef4679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.124737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb60d2d-c061-4748-93b4-50b327ef4679 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.134178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5037e-5ad3-4941-9157-d60961bcdaa9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.135886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 328/654] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:07.136681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb60d2d-c061-4748-93b4-50b327ef4679 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.172310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801b4c7-91cf-4620-8036-8a4efc0104af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.172844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801b4c7-91cf-4620-8036-8a4efc0104af None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.173124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801b4c7-91cf-4620-8036-8a4efc0104af None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.173389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801b4c7-91cf-4620-8036-8a4efc0104af None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.174065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801b4c7-91cf-4620-8036-8a4efc0104af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:07.174364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801b4c7-91cf-4620-8036-8a4efc0104af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.175735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801b4c7-91cf-4620-8036-8a4efc0104af None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.188053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 327/655] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:07.188846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801b4c7-91cf-4620-8036-8a4efc0104af None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.214597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.236865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb60d2d-c061-4748-93b4-50b327ef4679 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.271597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07319fb0-a2f3-40b0-b5a0-3b1ff9c77397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.272231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07319fb0-a2f3-40b0-b5a0-3b1ff9c77397 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.272503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07319fb0-a2f3-40b0-b5a0-3b1ff9c77397 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.272770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07319fb0-a2f3-40b0-b5a0-3b1ff9c77397 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.280027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07319fb0-a2f3-40b0-b5a0-3b1ff9c77397 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.281471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07319fb0-a2f3-40b0-b5a0-3b1ff9c77397 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.289908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801b4c7-91cf-4620-8036-8a4efc0104af None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-07319fb0-a2f3-40b0-b5a0-3b1ff9c77397 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:07.292382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:07.299064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 329/656] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45ab8-dd38-4e8b-9a96-b13794c75a22 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.300205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45ab8-dd38-4e8b-9a96-b13794c75a22 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.301002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45ab8-dd38-4e8b-9a96-b13794c75a22 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.301002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 330/657] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:07.301002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d45ab8-dd38-4e8b-9a96-b13794c75a22 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.315852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.327733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fcb77-c6c5-4ffc-bb2c-466226c44e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.328353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fcb77-c6c5-4ffc-bb2c-466226c44e44 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.328667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fcb77-c6c5-4ffc-bb2c-466226c44e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.328944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fcb77-c6c5-4ffc-bb2c-466226c44e44 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.329695 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fcb77-c6c5-4ffc-bb2c-466226c44e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:07.329999 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fcb77-c6c5-4ffc-bb2c-466226c44e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.331445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fcb77-c6c5-4ffc-bb2c-466226c44e44 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.342974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 328/658] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:07.343585 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fcb77-c6c5-4ffc-bb2c-466226c44e44 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.408656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d45ab8-dd38-4e8b-9a96-b13794c75a22 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.442020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fcb77-c6c5-4ffc-bb2c-466226c44e44 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.442797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69902a95-26f9-42b0-a635-b68787c99b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.443467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902a95-26f9-42b0-a635-b68787c99b2c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.443744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902a95-26f9-42b0-a635-b68787c99b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.444012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902a95-26f9-42b0-a635-b68787c99b2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.453319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69902a95-26f9-42b0-a635-b68787c99b2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.454716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69902a95-26f9-42b0-a635-b68787c99b2c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.456439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-69902a95-26f9-42b0-a635-b68787c99b2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:07.467925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:07.468839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:07.470232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:07.470232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:07.470232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:07.470232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:07.470232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:07.470232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:07.470232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:07.470232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:07.470232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 331/659] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:07.470713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69902a95-26f9-42b0-a635-b68787c99b2c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.479867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5a40e-4624-40ef-9d21-0958e5238c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.480507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5a40e-4624-40ef-9d21-0958e5238c1a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.480788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5a40e-4624-40ef-9d21-0958e5238c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.481066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5a40e-4624-40ef-9d21-0958e5238c1a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.489219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5a40e-4624-40ef-9d21-0958e5238c1a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.490646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5a40e-4624-40ef-9d21-0958e5238c1a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f9d5a40e-4624-40ef-9d21-0958e5238c1a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:07.501818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:07.502751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:07.503922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 329/660] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:07.504542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d38f-39f1-48fb-92ea-2249ce55e789 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.504648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d38f-39f1-48fb-92ea-2249ce55e789 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.504915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d38f-39f1-48fb-92ea-2249ce55e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.522005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5ec7d38f-39f1-48fb-92ea-2249ce55e789 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:07.523220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5ec7d38f-39f1-48fb-92ea-2249ce55e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:07.563753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.575435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69902a95-26f9-42b0-a635-b68787c99b2c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.591535 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 330/661] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:07.592336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7d38f-39f1-48fb-92ea-2249ce55e789 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.617192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689add8d-85c0-487b-8365-05cdc9826553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.617892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689add8d-85c0-487b-8365-05cdc9826553 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.618164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689add8d-85c0-487b-8365-05cdc9826553 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.618434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689add8d-85c0-487b-8365-05cdc9826553 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.619255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689add8d-85c0-487b-8365-05cdc9826553 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:07.619556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689add8d-85c0-487b-8365-05cdc9826553 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.620998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689add8d-85c0-487b-8365-05cdc9826553 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.637591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 332/662] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:07.638371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689add8d-85c0-487b-8365-05cdc9826553 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.697112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.705564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7d38f-39f1-48fb-92ea-2249ce55e789 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.742560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689add8d-85c0-487b-8365-05cdc9826553 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.743239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca6820-a824-4782-b1bb-6e6348c24c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.743862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca6820-a824-4782-b1bb-6e6348c24c5c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.744143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca6820-a824-4782-b1bb-6e6348c24c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.744415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca6820-a824-4782-b1bb-6e6348c24c5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.745203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca6820-a824-4782-b1bb-6e6348c24c5c None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=bd26e2ac2578438e854d51d8eed26463) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:07.745514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca6820-a824-4782-b1bb-6e6348c24c5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.746969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca6820-a824-4782-b1bb-6e6348c24c5c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.752802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 331/663] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/role_assignments?user.id=bd26e2ac2578438e854d51d8eed26463&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:07.753672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca6820-a824-4782-b1bb-6e6348c24c5c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.784724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b0b84-5cfa-41e4-bf7b-9e5af9846a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.785509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b0b84-5cfa-41e4-bf7b-9e5af9846a93 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.785788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b0b84-5cfa-41e4-bf7b-9e5af9846a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.786116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b0b84-5cfa-41e4-bf7b-9e5af9846a93 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.786899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b0b84-5cfa-41e4-bf7b-9e5af9846a93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:07.787293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b0b84-5cfa-41e4-bf7b-9e5af9846a93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.788951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b0b84-5cfa-41e4-bf7b-9e5af9846a93 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.807354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 333/664] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:07.807354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b0b84-5cfa-41e4-bf7b-9e5af9846a93 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.821478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.895542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca6820-a824-4782-b1bb-6e6348c24c5c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.918646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b0b84-5cfa-41e4-bf7b-9e5af9846a93 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:07.939972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:07.942611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1ddf9-57d9-424c-a407-76c12ac73005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.942898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1ddf9-57d9-424c-a407-76c12ac73005 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.943221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1ddf9-57d9-424c-a407-76c12ac73005 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.943506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1ddf9-57d9-424c-a407-76c12ac73005 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.944287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1ddf9-57d9-424c-a407-76c12ac73005 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:07.944587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1ddf9-57d9-424c-a407-76c12ac73005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:07.946011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1ddf9-57d9-424c-a407-76c12ac73005 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:07.964672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4328c-3009-4a37-bc08-f9e1aab88139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:07.965207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 332/665] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:07.965317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4328c-3009-4a37-bc08-f9e1aab88139 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:07.965508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4328c-3009-4a37-bc08-f9e1aab88139 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:07.965778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4328c-3009-4a37-bc08-f9e1aab88139 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:07.965947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1ddf9-57d9-424c-a407-76c12ac73005 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:07.978881 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4328c-3009-4a37-bc08-f9e1aab88139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d4e4328c-3009-4a37-bc08-f9e1aab88139 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:07.984420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:07.986312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 334/666] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:07.987872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4328c-3009-4a37-bc08-f9e1aab88139 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:08.090132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:08.098215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1ddf9-57d9-424c-a407-76c12ac73005 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:08.107321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4328c-3009-4a37-bc08-f9e1aab88139 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:08.137437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2afaf-3e5e-4a69-8457-51a35e0d3200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:08.138056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2afaf-3e5e-4a69-8457-51a35e0d3200 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:08.138334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2afaf-3e5e-4a69-8457-51a35e0d3200 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:08.138604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2afaf-3e5e-4a69-8457-51a35e0d3200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:08.143331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9d862-f0f4-430e-92cb-322c9c67aaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:08.143951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9d862-f0f4-430e-92cb-322c9c67aaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:08.144240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9d862-f0f4-430e-92cb-322c9c67aaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:08.144516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9d862-f0f4-430e-92cb-322c9c67aaf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:08.145302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9d862-f0f4-430e-92cb-322c9c67aaf6 None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=955c6cb8893c473fadd028b12bbea69d) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:08.145612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9d862-f0f4-430e-92cb-322c9c67aaf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:08.147075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9d862-f0f4-430e-92cb-322c9c67aaf6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:08.163017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 335/667] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/role_assignments?user.id=955c6cb8893c473fadd028b12bbea69d&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:08.163017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9d862-f0f4-430e-92cb-322c9c67aaf6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:08.210600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:08.230757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2afaf-3e5e-4a69-8457-51a35e0d3200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:08.232766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2afaf-3e5e-4a69-8457-51a35e0d3200 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:08.286538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9d862-f0f4-430e-92cb-322c9c67aaf6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:08.329082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d0e97-6422-4355-aca2-0d84b67467d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:08.330254 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0e97-6422-4355-aca2-0d84b67467d9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:08.330807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0e97-6422-4355-aca2-0d84b67467d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:08.331213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0e97-6422-4355-aca2-0d84b67467d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:08.357629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:08.363710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 333/668] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:08.364704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2afaf-3e5e-4a69-8457-51a35e0d3200 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:08.434840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d0e97-6422-4355-aca2-0d84b67467d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:08.436936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d0e97-6422-4355-aca2-0d84b67467d9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:08.489445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:08.500634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2afaf-3e5e-4a69-8457-51a35e0d3200 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:08.539263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdec43c-45d7-46b3-9363-89e9897b8607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:08.539884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdec43c-45d7-46b3-9363-89e9897b8607 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:08.540215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdec43c-45d7-46b3-9363-89e9897b8607 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:08.540653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdec43c-45d7-46b3-9363-89e9897b8607 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:08.541275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdec43c-45d7-46b3-9363-89e9897b8607 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:08.541584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdec43c-45d7-46b3-9363-89e9897b8607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:08.542947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdec43c-45d7-46b3-9363-89e9897b8607 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:08.553451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 334/669] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:08.554881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdec43c-45d7-46b3-9363-89e9897b8607 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:08.558749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 336/670] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:08.559826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d0e97-6422-4355-aca2-0d84b67467d9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:08.621914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:08.668148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d0e97-6422-4355-aca2-0d84b67467d9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:08.668547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdec43c-45d7-46b3-9363-89e9897b8607 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:08.704371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd24d0-3d43-48f8-a9c5-923748100ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:08.705016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd24d0-3d43-48f8-a9c5-923748100ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:08.705297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd24d0-3d43-48f8-a9c5-923748100ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:08.705570 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd24d0-3d43-48f8-a9c5-923748100ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:08.707176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e66a8c-1bfd-4058-9538-78bae711ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:08.708474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e66a8c-1bfd-4058-9538-78bae711ad4f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:08.708956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e66a8c-1bfd-4058-9538-78bae711ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:08.709416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e66a8c-1bfd-4058-9538-78bae711ad4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:08.714066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:08.716613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd24d0-3d43-48f8-a9c5-923748100ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:08.718133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd24d0-3d43-48f8-a9c5-923748100ba6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:08.724231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e66a8c-1bfd-4058-9538-78bae711ad4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:08.726019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e66a8c-1bfd-4058-9538-78bae711ad4f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d5cd24d0-3d43-48f8-a9c5-923748100ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:08.733680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:08.735110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:08.735981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:08.735981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:08.735981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:08.735981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:08.735981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 337/671] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:08.736961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd24d0-3d43-48f8-a9c5-923748100ba6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-82e66a8c-1bfd-4058-9538-78bae711ad4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:08.751667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:08.752552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:08.753419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:08.753419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:08.753419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:08.753419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:08.753419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 335/672] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:08.754110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e66a8c-1bfd-4058-9538-78bae711ad4f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:08.860401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd24d0-3d43-48f8-a9c5-923748100ba6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:08.889454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e66a8c-1bfd-4058-9538-78bae711ad4f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:08.901587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:08.902935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a03c4-61b1-4fc0-afab-88dbf11f5c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:08.903847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a03c4-61b1-4fc0-afab-88dbf11f5c93 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:08.904412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a03c4-61b1-4fc0-afab-88dbf11f5c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:08.904691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a03c4-61b1-4fc0-afab-88dbf11f5c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:08.920886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a03c4-61b1-4fc0-afab-88dbf11f5c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:08.924016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a03c4-61b1-4fc0-afab-88dbf11f5c93 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:08.932009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde9ba5-9071-459f-91c8-9961b0c16338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:08.932892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde9ba5-9071-459f-91c8-9961b0c16338 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:08.933399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde9ba5-9071-459f-91c8-9961b0c16338 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:08.933879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde9ba5-9071-459f-91c8-9961b0c16338 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:08.934757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde9ba5-9071-459f-91c8-9961b0c16338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:08.935270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde9ba5-9071-459f-91c8-9961b0c16338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:08.936800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde9ba5-9071-459f-91c8-9961b0c16338 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-310a03c4-61b1-4fc0-afab-88dbf11f5c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:08.941605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:08.942481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:08.943403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:08.943403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:08.943403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:08.943403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:08.947069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 338/673] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:08.948754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a03c4-61b1-4fc0-afab-88dbf11f5c93 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:08.954542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 336/674] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:08.955670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde9ba5-9071-459f-91c8-9961b0c16338 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:09.007249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:09.080827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde9ba5-9071-459f-91c8-9961b0c16338 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.084525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a03c4-61b1-4fc0-afab-88dbf11f5c93 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.116947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41813928-b153-4548-8a86-a455514a5409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.117944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41813928-b153-4548-8a86-a455514a5409 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.118446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41813928-b153-4548-8a86-a455514a5409 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.119085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41813928-b153-4548-8a86-a455514a5409 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.119920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41813928-b153-4548-8a86-a455514a5409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:09.120369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41813928-b153-4548-8a86-a455514a5409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:09.121879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41813928-b153-4548-8a86-a455514a5409 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:09.128034 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b79c54-9bb2-4738-80c0-7b390fa183ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.128910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b79c54-9bb2-4738-80c0-7b390fa183ee None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.129428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b79c54-9bb2-4738-80c0-7b390fa183ee None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.130471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b79c54-9bb2-4738-80c0-7b390fa183ee None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.131400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b79c54-9bb2-4738-80c0-7b390fa183ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:09.132454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b79c54-9bb2-4738-80c0-7b390fa183ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:09.134321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b79c54-9bb2-4738-80c0-7b390fa183ee None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:09.135371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 337/675] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:09.136190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41813928-b153-4548-8a86-a455514a5409 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:09.155130 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 339/676] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:09.155130 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b79c54-9bb2-4738-80c0-7b390fa183ee None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:09.180866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:09.259176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b79c54-9bb2-4738-80c0-7b390fa183ee None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.262351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:09.282890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41813928-b153-4548-8a86-a455514a5409 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.303782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0c72-5337-4107-8b15-7d8575c07a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.304418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0c72-5337-4107-8b15-7d8575c07a88 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.304692 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0c72-5337-4107-8b15-7d8575c07a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.304957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0c72-5337-4107-8b15-7d8575c07a88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.316710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f0c72-5337-4107-8b15-7d8575c07a88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:09.319724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f0c72-5337-4107-8b15-7d8575c07a88 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:09.322872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5af8-958f-4ab4-a3b5-41aa3cb21ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.323403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5af8-958f-4ab4-a3b5-41aa3cb21ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.323676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5af8-958f-4ab4-a3b5-41aa3cb21ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.323942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5af8-958f-4ab4-a3b5-41aa3cb21ed7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.331912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea5af8-958f-4ab4-a3b5-41aa3cb21ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:09.333337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea5af8-958f-4ab4-a3b5-41aa3cb21ed7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-117f0c72-5337-4107-8b15-7d8575c07a88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:09.334558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:09.335441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:09.336312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:09.336312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:09.336312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:09.336312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:09.336312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:09.336312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:09.336312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:09.336312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:09.336731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 340/677] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:09.337429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0c72-5337-4107-8b15-7d8575c07a88 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-e4ea5af8-958f-4ab4-a3b5-41aa3cb21ed7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:09.350542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:09.351525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:09.352434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 338/678] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:09.353012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5af8-958f-4ab4-a3b5-41aa3cb21ed7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:09.456788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:09.465878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0c72-5337-4107-8b15-7d8575c07a88 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.469936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5af8-958f-4ab4-a3b5-41aa3cb21ed7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.507409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b294a-7d9d-47d8-aad4-8e5eed99d597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.508455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b294a-7d9d-47d8-aad4-8e5eed99d597 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.508984 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b294a-7d9d-47d8-aad4-8e5eed99d597 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.509549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b294a-7d9d-47d8-aad4-8e5eed99d597 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.511248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243771f-94aa-4425-8d32-f5673346f24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.511882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243771f-94aa-4425-8d32-f5673346f24c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.512464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243771f-94aa-4425-8d32-f5673346f24c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.512756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243771f-94aa-4425-8d32-f5673346f24c None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.513595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243771f-94aa-4425-8d32-f5673346f24c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:09.514361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243771f-94aa-4425-8d32-f5673346f24c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:09.515941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243771f-94aa-4425-8d32-f5673346f24c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:09.519494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b294a-7d9d-47d8-aad4-8e5eed99d597 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:09.521099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b294a-7d9d-47d8-aad4-8e5eed99d597 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-339b294a-7d9d-47d8-aad4-8e5eed99d597 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:09.534348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:09.535372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:09.536255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:09.536255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:09.536255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:09.536255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:09.536255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:09.536255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:09.536255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:09.536255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:09.536679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 339/679] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:09.536679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243771f-94aa-4425-8d32-f5673346f24c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:09.538741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 341/680] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:09.539854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b294a-7d9d-47d8-aad4-8e5eed99d597 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:09.569186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:09.653094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b294a-7d9d-47d8-aad4-8e5eed99d597 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.669292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243771f-94aa-4425-8d32-f5673346f24c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.689448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2b03-5344-4774-9ef1-6bf7248af309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.690288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2b03-5344-4774-9ef1-6bf7248af309 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.690740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2b03-5344-4774-9ef1-6bf7248af309 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.691193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2b03-5344-4774-9ef1-6bf7248af309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.692220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2b03-5344-4774-9ef1-6bf7248af309 None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=c426cc367a1843d38978d3b8e636276e) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:09.692683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2b03-5344-4774-9ef1-6bf7248af309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:09.694323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2b03-5344-4774-9ef1-6bf7248af309 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:09.700878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 342/681] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:09 2022] GET /identity/v3/role_assignments?user.id=c426cc367a1843d38978d3b8e636276e&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:09.707829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2b03-5344-4774-9ef1-6bf7248af309 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:09.729836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440ccdf-207c-4cab-a77c-1142c60dd84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.730550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440ccdf-207c-4cab-a77c-1142c60dd84a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.730745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440ccdf-207c-4cab-a77c-1142c60dd84a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.731017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440ccdf-207c-4cab-a77c-1142c60dd84a None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.731837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440ccdf-207c-4cab-a77c-1142c60dd84a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:09.732139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440ccdf-207c-4cab-a77c-1142c60dd84a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:09.733579 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440ccdf-207c-4cab-a77c-1142c60dd84a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:09.770958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 340/682] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Aug 4 04:28:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:09.776694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440ccdf-207c-4cab-a77c-1142c60dd84a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:09.795565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:09.923228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440ccdf-207c-4cab-a77c-1142c60dd84a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.927712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:09.946834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2b03-5344-4774-9ef1-6bf7248af309 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:09.972733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a6078-17ea-41d7-a861-d2b847fda90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.973425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a6078-17ea-41d7-a861-d2b847fda90d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.973783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a6078-17ea-41d7-a861-d2b847fda90d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.974070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a6078-17ea-41d7-a861-d2b847fda90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.989721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9c568-5888-4cfe-ba27-24531d497042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:09.990383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9c568-5888-4cfe-ba27-24531d497042 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:09.990669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9c568-5888-4cfe-ba27-24531d497042 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:09.990934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9c568-5888-4cfe-ba27-24531d497042 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:09.991741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9c568-5888-4cfe-ba27-24531d497042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:09.992042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9c568-5888-4cfe-ba27-24531d497042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:09.993452 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9c568-5888-4cfe-ba27-24531d497042 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:10.006482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 343/683] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:10.007883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb7966-a09c-4e8f-aba1-c7eeb718a2d2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.008163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb7966-a09c-4e8f-aba1-c7eeb718a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.008435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb7966-a09c-4e8f-aba1-c7eeb718a2d2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.009961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 344/684] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:10.014632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb7966-a09c-4e8f-aba1-c7eeb718a2d2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:10.055499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a6078-17ea-41d7-a861-d2b847fda90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:10.057850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a6078-17ea-41d7-a861-d2b847fda90d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:10.070731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:10.137089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb7966-a09c-4e8f-aba1-c7eeb718a2d2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:10.178787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ccb7c-b200-4f91-bfc3-196058e26cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:10.179449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccb7c-b200-4f91-bfc3-196058e26cdb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.179731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccb7c-b200-4f91-bfc3-196058e26cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.180012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccb7c-b200-4f91-bfc3-196058e26cdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.180799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ccb7c-b200-4f91-bfc3-196058e26cdb None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=7a7ad7efdc2849ca98386decbfd77879) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:10.181106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ccb7c-b200-4f91-bfc3-196058e26cdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:10.182222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 341/685] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:10.182608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ccb7c-b200-4f91-bfc3-196058e26cdb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:10.183952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475f70-f50f-4620-bae8-aaaa8d75fe28 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.184418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475f70-f50f-4620-bae8-aaaa8d75fe28 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.184885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f475f70-f50f-4620-bae8-aaaa8d75fe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.199030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 345/686] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:10 2022] GET /identity/v3/role_assignments?user.id=7a7ad7efdc2849ca98386decbfd77879&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:10.199030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ccb7c-b200-4f91-bfc3-196058e26cdb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:10.220014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1f475f70-f50f-4620-bae8-aaaa8d75fe28 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:10.222507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1f475f70-f50f-4620-bae8-aaaa8d75fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:10.224790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:10.329984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 342/687] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:10.357988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f475f70-f50f-4620-bae8-aaaa8d75fe28 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:10.398704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ccb7c-b200-4f91-bfc3-196058e26cdb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:10.449947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:10.475779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d667-6cd3-4a7a-a09c-00fe3ad2800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:10.476758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d667-6cd3-4a7a-a09c-00fe3ad2800a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.477216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d667-6cd3-4a7a-a09c-00fe3ad2800a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.478535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d667-6cd3-4a7a-a09c-00fe3ad2800a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.491548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d667-6cd3-4a7a-a09c-00fe3ad2800a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:10.493967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d667-6cd3-4a7a-a09c-00fe3ad2800a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3573d667-6cd3-4a7a-a09c-00fe3ad2800a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:10.513527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:10.514493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:10.516733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:10.516733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:10.516733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:10.516733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:10.516733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 346/688] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:10.516733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc4577-fb68-4173-9e81-0c2d1b1a38d7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.516733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc4577-fb68-4173-9e81-0c2d1b1a38d7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.517119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc4577-fb68-4173-9e81-0c2d1b1a38d7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.518412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 347/689] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:10.524532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb6b19-eb94-4c94-bd53-767b27220f41 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.524532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb6b19-eb94-4c94-bd53-767b27220f41 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.524532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb6b19-eb94-4c94-bd53-767b27220f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.535894 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f475f70-f50f-4620-bae8-aaaa8d75fe28 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:10.547438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-59cb6b19-eb94-4c94-bd53-767b27220f41 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:10.548765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-59cb6b19-eb94-4c94-bd53-767b27220f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:10.583849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be864e0a-1ad0-4654-b499-6753e87634a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:10.585004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be864e0a-1ad0-4654-b499-6753e87634a3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.585290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be864e0a-1ad0-4654-b499-6753e87634a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.585565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be864e0a-1ad0-4654-b499-6753e87634a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.598409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be864e0a-1ad0-4654-b499-6753e87634a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-be864e0a-1ad0-4654-b499-6753e87634a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:10.604889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:10.606009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:10.607024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 343/690] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:10.607861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be864e0a-1ad0-4654-b499-6753e87634a3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:10.620411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:10.632787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 348/691] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:10.633861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb6b19-eb94-4c94-bd53-767b27220f41 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:10.733429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:10.740993 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be864e0a-1ad0-4654-b499-6753e87634a3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:10.761236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb6b19-eb94-4c94-bd53-767b27220f41 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:10.782620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5519ca0-12d2-4423-b3c3-b5c7d92a998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:10.783610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5519ca0-12d2-4423-b3c3-b5c7d92a998a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.784070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5519ca0-12d2-4423-b3c3-b5c7d92a998a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.784516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5519ca0-12d2-4423-b3c3-b5c7d92a998a None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.785479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5519ca0-12d2-4423-b3c3-b5c7d92a998a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:10.786023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5519ca0-12d2-4423-b3c3-b5c7d92a998a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:10.787629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5519ca0-12d2-4423-b3c3-b5c7d92a998a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:10.801219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 344/692] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:10.802505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5519ca0-12d2-4423-b3c3-b5c7d92a998a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:10.804143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6a033-2c6e-45ff-a3f5-1f75a2e8e42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:10.804834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6a033-2c6e-45ff-a3f5-1f75a2e8e42e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.805211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6a033-2c6e-45ff-a3f5-1f75a2e8e42e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.805721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6a033-2c6e-45ff-a3f5-1f75a2e8e42e None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.806554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6a033-2c6e-45ff-a3f5-1f75a2e8e42e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:10.806861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6a033-2c6e-45ff-a3f5-1f75a2e8e42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:10.808365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6a033-2c6e-45ff-a3f5-1f75a2e8e42e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:10.821112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 349/693] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:10.822709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6a033-2c6e-45ff-a3f5-1f75a2e8e42e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:10.885746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:10.916426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5519ca0-12d2-4423-b3c3-b5c7d92a998a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:10.934558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6a033-2c6e-45ff-a3f5-1f75a2e8e42e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:10.955843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94658d-52f9-49bd-913a-398615d9f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:10.956931 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94658d-52f9-49bd-913a-398615d9f9ae None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.957412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94658d-52f9-49bd-913a-398615d9f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.958088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94658d-52f9-49bd-913a-398615d9f9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.970424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94658d-52f9-49bd-913a-398615d9f9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:10.971593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3014c0-9442-42bc-b6a3-2cdb93e730be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:10.972237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3014c0-9442-42bc-b6a3-2cdb93e730be None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:10.972517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3014c0-9442-42bc-b6a3-2cdb93e730be None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:10.972789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3014c0-9442-42bc-b6a3-2cdb93e730be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:10.973382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94658d-52f9-49bd-913a-398615d9f9ae None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:10.980203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3014c0-9442-42bc-b6a3-2cdb93e730be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:10.981737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3014c0-9442-42bc-b6a3-2cdb93e730be None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9c94658d-52f9-49bd-913a-398615d9f9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:10.990420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:10.991495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:10.992584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:10.992584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:10.992584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:10.992584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:10.994042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 345/694] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-1b3014c0-9442-42bc-b6a3-2cdb93e730be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:10.994141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:10.995093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:10.996241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:10.996241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:10.996241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:10.996241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:10.996241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:10.996241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:10.996241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:10.996241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:10.996241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 350/695] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:10.996953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94658d-52f9-49bd-913a-398615d9f9ae None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:11.003061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3014c0-9442-42bc-b6a3-2cdb93e730be None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:11.011529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:11.105977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94658d-52f9-49bd-913a-398615d9f9ae None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:11.114927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3014c0-9442-42bc-b6a3-2cdb93e730be None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:11.135339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:11.143928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223510d-a446-4c74-a811-99e1db277245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:11.144517 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223510d-a446-4c74-a811-99e1db277245 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:11.144799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223510d-a446-4c74-a811-99e1db277245 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:11.145075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223510d-a446-4c74-a811-99e1db277245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:11.155576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c8ce8-b72c-4a96-87f2-f670facf9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:11.156982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c8ce8-b72c-4a96-87f2-f670facf9db2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:11.157271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c8ce8-b72c-4a96-87f2-f670facf9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:11.157543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c8ce8-b72c-4a96-87f2-f670facf9db2 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:11.157669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223510d-a446-4c74-a811-99e1db277245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:11.158390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c8ce8-b72c-4a96-87f2-f670facf9db2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:11.158702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c8ce8-b72c-4a96-87f2-f670facf9db2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:11.159199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223510d-a446-4c74-a811-99e1db277245 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:11.160180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c8ce8-b72c-4a96-87f2-f670facf9db2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d223510d-a446-4c74-a811-99e1db277245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:11.174686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:11.175796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:11.176790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:11.176790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:11.176790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:11.176790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:11.176790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 346/696] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:11.177141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223510d-a446-4c74-a811-99e1db277245 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:11.183228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 351/697] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:11.184190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c8ce8-b72c-4a96-87f2-f670facf9db2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:11.263713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:11.290022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c8ce8-b72c-4a96-87f2-f670facf9db2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:11.314734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223510d-a446-4c74-a811-99e1db277245 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:11.326594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0915e-d245-4db0-9c0e-f5c382ebfd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:11.327434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0915e-d245-4db0-9c0e-f5c382ebfd2d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:11.328024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0915e-d245-4db0-9c0e-f5c382ebfd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:11.328145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0915e-d245-4db0-9c0e-f5c382ebfd2d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:11.328841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0915e-d245-4db0-9c0e-f5c382ebfd2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:11.329168 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0915e-d245-4db0-9c0e-f5c382ebfd2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:11.330505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0915e-d245-4db0-9c0e-f5c382ebfd2d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:11.347492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 352/698] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:11.347492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0915e-d245-4db0-9c0e-f5c382ebfd2d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:11.362802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b06f0-fbbc-42d5-8689-678324cdfabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:11.363990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b06f0-fbbc-42d5-8689-678324cdfabe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:11.364420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b06f0-fbbc-42d5-8689-678324cdfabe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:11.364998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b06f0-fbbc-42d5-8689-678324cdfabe None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:11.366142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b06f0-fbbc-42d5-8689-678324cdfabe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:11.366615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b06f0-fbbc-42d5-8689-678324cdfabe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:11.368170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b06f0-fbbc-42d5-8689-678324cdfabe None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:11.384296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:11.385933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 347/699] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:11.386665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b06f0-fbbc-42d5-8689-678324cdfabe None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:11.474789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0915e-d245-4db0-9c0e-f5c382ebfd2d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:11.502159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b06f0-fbbc-42d5-8689-678324cdfabe None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:11.518329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0edb-c916-4575-b779-fa707e0c823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:11.518960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0edb-c916-4575-b779-fa707e0c823e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:11.519272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0edb-c916-4575-b779-fa707e0c823e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:11.519545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0edb-c916-4575-b779-fa707e0c823e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:11.520340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0edb-c916-4575-b779-fa707e0c823e None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=5dcb9d2fbde74819b3848d050299cfe9) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:11.520648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0edb-c916-4575-b779-fa707e0c823e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:11.522139 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0edb-c916-4575-b779-fa707e0c823e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:11.528764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 353/700] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:11 2022] GET /identity/v3/role_assignments?user.id=5dcb9d2fbde74819b3848d050299cfe9&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:11.529788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0edb-c916-4575-b779-fa707e0c823e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:11.541987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:11.568742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993bf88-f369-4532-b31f-618a221a540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:11.569413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993bf88-f369-4532-b31f-618a221a540c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:11.569697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993bf88-f369-4532-b31f-618a221a540c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:11.569972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993bf88-f369-4532-b31f-618a221a540c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:11.588026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993bf88-f369-4532-b31f-618a221a540c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:11.589666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993bf88-f369-4532-b31f-618a221a540c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3993bf88-f369-4532-b31f-618a221a540c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:11.615953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:11.616948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:11.617862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:11.618379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 348/701] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Aug 4 04:28:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:11.626024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993bf88-f369-4532-b31f-618a221a540c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:11.718759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:11.723266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0edb-c916-4575-b779-fa707e0c823e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:11.776013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e05ead-cf40-4734-9561-e0270d2af067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:11.776634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e05ead-cf40-4734-9561-e0270d2af067 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:11.776911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e05ead-cf40-4734-9561-e0270d2af067 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:11.777429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e05ead-cf40-4734-9561-e0270d2af067 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:11.778574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e05ead-cf40-4734-9561-e0270d2af067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:11.780273 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e05ead-cf40-4734-9561-e0270d2af067 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:11.819661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993bf88-f369-4532-b31f-618a221a540c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:11.820682 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 354/702] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:28:11 2022] POST /identity/v3/users => generated 254 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:11.860701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9636e86-84dc-41df-a83b-a7873d105757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:11.861332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9636e86-84dc-41df-a83b-a7873d105757 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:11.861605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9636e86-84dc-41df-a83b-a7873d105757 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:11.861930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9636e86-84dc-41df-a83b-a7873d105757 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:11.862752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9636e86-84dc-41df-a83b-a7873d105757 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:11.863095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9636e86-84dc-41df-a83b-a7873d105757 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:11.864653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9636e86-84dc-41df-a83b-a7873d105757 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:11.886012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 349/703] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Aug 4 04:28:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:11.892647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e05ead-cf40-4734-9561-e0270d2af067 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:12.014142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e05ead-cf40-4734-9561-e0270d2af067 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:12.018375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118058a-2016-47a0-b88f-c76e2e3e710a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:12.018908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118058a-2016-47a0-b88f-c76e2e3e710a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:12.019415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118058a-2016-47a0-b88f-c76e2e3e710a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:12.021307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 350/704] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:12.026836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30fb0-3d87-4a08-bfca-cf5c6b17affa None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:12.027479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30fb0-3d87-4a08-bfca-cf5c6b17affa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:12.027953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30fb0-3d87-4a08-bfca-cf5c6b17affa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:12.049447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-85c30fb0-3d87-4a08-bfca-cf5c6b17affa None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:12.051027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-85c30fb0-3d87-4a08-bfca-cf5c6b17affa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:12.061077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f428b-2304-4e43-bd02-72d3e44e40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:12.061710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f428b-2304-4e43-bd02-72d3e44e40c9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:12.061989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f428b-2304-4e43-bd02-72d3e44e40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:12.062256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f428b-2304-4e43-bd02-72d3e44e40c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:12.104818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:12.112153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:12.153988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 351/705] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:28:12.164633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f428b-2304-4e43-bd02-72d3e44e40c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:12.166109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f428b-2304-4e43-bd02-72d3e44e40c9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:12.177360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30fb0-3d87-4a08-bfca-cf5c6b17affa None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:12.302213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30fb0-3d87-4a08-bfca-cf5c6b17affa None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:12.342674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0c49-b445-44f1-a6de-e01930d923c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:12.343378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0c49-b445-44f1-a6de-e01930d923c2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:12.343656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0c49-b445-44f1-a6de-e01930d923c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:12.344022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0c49-b445-44f1-a6de-e01930d923c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:12.344665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0c49-b445-44f1-a6de-e01930d923c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:12.346058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0c49-b445-44f1-a6de-e01930d923c2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4a7e0c49-b445-44f1-a6de-e01930d923c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:12.358198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:12.359442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:12.361309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 352/706] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:12 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:12.365688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0c49-b445-44f1-a6de-e01930d923c2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:12.432558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:12.438201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 355/707] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:12.445538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f428b-2304-4e43-bd02-72d3e44e40c9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:12.549234 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0c49-b445-44f1-a6de-e01930d923c2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:12.567572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:12.606044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f95002-6705-412e-b71d-47e099c692e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:12.607481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f95002-6705-412e-b71d-47e099c692e3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:12.607996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f95002-6705-412e-b71d-47e099c692e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:12.608749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f95002-6705-412e-b71d-47e099c692e3 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:12.610275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f95002-6705-412e-b71d-47e099c692e3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:12.610785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f95002-6705-412e-b71d-47e099c692e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:12.612913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f95002-6705-412e-b71d-47e099c692e3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:12.620232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 353/708] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:12.625429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f428b-2304-4e43-bd02-72d3e44e40c9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:12.625553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b4bc-c522-4357-be0f-2d9b76a8b93f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:12.625553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b4bc-c522-4357-be0f-2d9b76a8b93f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:12.625553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b4bc-c522-4357-be0f-2d9b76a8b93f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:12.627058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 354/709] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:12.628042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86b4bc-c522-4357-be0f-2d9b76a8b93f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:12.664954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f71b09-e540-4f00-b0b6-89b04af6e20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:12.666135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71b09-e540-4f00-b0b6-89b04af6e20c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:12.666931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71b09-e540-4f00-b0b6-89b04af6e20c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:12.667592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71b09-e540-4f00-b0b6-89b04af6e20c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:12.682033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f71b09-e540-4f00-b0b6-89b04af6e20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:12.684069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f71b09-e540-4f00-b0b6-89b04af6e20c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-30f71b09-e540-4f00-b0b6-89b04af6e20c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:12.703652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:12.704576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:12.705456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:12.705456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:12.705456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:12.705456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:12.711152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 356/710] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:12.712956 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6414cb-7636-42d9-b18e-f3f09294a7e8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:12.712956 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6414cb-7636-42d9-b18e-f3f09294a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:12.713317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6414cb-7636-42d9-b18e-f3f09294a7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:12.734193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ae6414cb-7636-42d9-b18e-f3f09294a7e8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:12.734193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ae6414cb-7636-42d9-b18e-f3f09294a7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:12.766870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:12.771571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86b4bc-c522-4357-be0f-2d9b76a8b93f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:12.812233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f626c-7a8e-45e1-a4e8-dcb354bf8aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:12.813365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f626c-7a8e-45e1-a4e8-dcb354bf8aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:12.813646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f626c-7a8e-45e1-a4e8-dcb354bf8aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:12.814008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f626c-7a8e-45e1-a4e8-dcb354bf8aa2 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:12.814594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f626c-7a8e-45e1-a4e8-dcb354bf8aa2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:12.814895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f626c-7a8e-45e1-a4e8-dcb354bf8aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:12.816290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f626c-7a8e-45e1-a4e8-dcb354bf8aa2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:12.831251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 357/712] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:12.831492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 355/712] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:12.832467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f626c-7a8e-45e1-a4e8-dcb354bf8aa2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:12.851705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6414cb-7636-42d9-b18e-f3f09294a7e8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:12.900087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:12.975646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6414cb-7636-42d9-b18e-f3f09294a7e8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:13.027560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868efb1-3e36-4b0d-b15a-4d2e0f3890c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:13.028283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868efb1-3e36-4b0d-b15a-4d2e0f3890c9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:13.028490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868efb1-3e36-4b0d-b15a-4d2e0f3890c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:13.029565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868efb1-3e36-4b0d-b15a-4d2e0f3890c9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:13.029565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868efb1-3e36-4b0d-b15a-4d2e0f3890c9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:13.030907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868efb1-3e36-4b0d-b15a-4d2e0f3890c9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-1868efb1-3e36-4b0d-b15a-4d2e0f3890c9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:13.053082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:13.054061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:13.055066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 358/713] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Aug 4 04:28:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:13.062475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868efb1-3e36-4b0d-b15a-4d2e0f3890c9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:13.072078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f626c-7a8e-45e1-a4e8-dcb354bf8aa2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:13.108677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c4765-13e6-4eea-b87e-867596bff45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:13.109218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c4765-13e6-4eea-b87e-867596bff45e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:13.109522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c4765-13e6-4eea-b87e-867596bff45e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:13.109796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c4765-13e6-4eea-b87e-867596bff45e None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:13.110491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c4765-13e6-4eea-b87e-867596bff45e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:13.110795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c4765-13e6-4eea-b87e-867596bff45e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:13.112272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c4765-13e6-4eea-b87e-867596bff45e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:13.130549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 356/714] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:13.131480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c4765-13e6-4eea-b87e-867596bff45e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:13.156674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:13.181167 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868efb1-3e36-4b0d-b15a-4d2e0f3890c9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:13.183322 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:13.221674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f444b-1538-4f63-b0a3-2a8757711516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:13.222620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f444b-1538-4f63-b0a3-2a8757711516 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:13.223073 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f444b-1538-4f63-b0a3-2a8757711516 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:13.223527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f444b-1538-4f63-b0a3-2a8757711516 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:13.224349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f444b-1538-4f63-b0a3-2a8757711516 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:13.224844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f444b-1538-4f63-b0a3-2a8757711516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:13.226434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f444b-1538-4f63-b0a3-2a8757711516 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:13.231947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 359/715] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Aug 4 04:28:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:13.238006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f444b-1538-4f63-b0a3-2a8757711516 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:13.241506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c4765-13e6-4eea-b87e-867596bff45e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:13.278949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdae4b-a6b6-423f-bb15-39d1b5b1b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:13.279637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdae4b-a6b6-423f-bb15-39d1b5b1b449 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:13.279892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdae4b-a6b6-423f-bb15-39d1b5b1b449 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:13.280168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdae4b-a6b6-423f-bb15-39d1b5b1b449 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:13.287983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdae4b-a6b6-423f-bb15-39d1b5b1b449 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:13.289432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdae4b-a6b6-423f-bb15-39d1b5b1b449 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-42cdae4b-a6b6-423f-bb15-39d1b5b1b449 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:13.302317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:13.303259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:13.304104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:13.304104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:13.304104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:13.304104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:13.304104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:13.304104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:13.304104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:13.304104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:13.304104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 357/716] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:13.309282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdae4b-a6b6-423f-bb15-39d1b5b1b449 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:13.365853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f444b-1538-4f63-b0a3-2a8757711516 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:13.410177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15fe5c-c05d-4bbc-a29f-c89157b3e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:13.411175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15fe5c-c05d-4bbc-a29f-c89157b3e6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:13.411763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15fe5c-c05d-4bbc-a29f-c89157b3e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:13.412230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15fe5c-c05d-4bbc-a29f-c89157b3e6b3 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:13.413423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15fe5c-c05d-4bbc-a29f-c89157b3e6b3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:13.413949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15fe5c-c05d-4bbc-a29f-c89157b3e6b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:13.416165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15fe5c-c05d-4bbc-a29f-c89157b3e6b3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:13.423754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 360/717] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Aug 4 04:28:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:13.465868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:13.500677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdae4b-a6b6-423f-bb15-39d1b5b1b449 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:13.546225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172810b-f072-4982-bff9-4a7c70736a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:13.548153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172810b-f072-4982-bff9-4a7c70736a30 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:13.548692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172810b-f072-4982-bff9-4a7c70736a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:13.549171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172810b-f072-4982-bff9-4a7c70736a30 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:13.550244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172810b-f072-4982-bff9-4a7c70736a30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:13.550962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172810b-f072-4982-bff9-4a7c70736a30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:13.552755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172810b-f072-4982-bff9-4a7c70736a30 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:13.567192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 358/718] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:13.576206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15fe5c-c05d-4bbc-a29f-c89157b3e6b3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:13.626112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:13.714616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15fe5c-c05d-4bbc-a29f-c89157b3e6b3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:13.750346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d28e3c-dd8c-4fde-a4b3-a510072cf068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:13.750964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d28e3c-dd8c-4fde-a4b3-a510072cf068 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:13.751279 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d28e3c-dd8c-4fde-a4b3-a510072cf068 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:13.751555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d28e3c-dd8c-4fde-a4b3-a510072cf068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:13.752373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d28e3c-dd8c-4fde-a4b3-a510072cf068 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=642faef2d1654874bd7205420512998a, user.id=bd26e2ac2578438e854d51d8eed26463) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:13.752657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d28e3c-dd8c-4fde-a4b3-a510072cf068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:13.754531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d28e3c-dd8c-4fde-a4b3-a510072cf068 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:13.762337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 361/719] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:13 2022] GET /identity/v3/role_assignments?user.id=bd26e2ac2578438e854d51d8eed26463&scope.project.id=642faef2d1654874bd7205420512998a&role.id=c1429555635349208e8b2bd908436746 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:14.346764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f96f-4f11-427e-9efc-54b690a24b9a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:14.347302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f96f-4f11-427e-9efc-54b690a24b9a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:14.347377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f96f-4f11-427e-9efc-54b690a24b9a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:14.348964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 359/720] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:14.354259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996ef1-c543-44ee-9bfa-d12f39f298bf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:14.354650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996ef1-c543-44ee-9bfa-d12f39f298bf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:14.354880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996ef1-c543-44ee-9bfa-d12f39f298bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:14.376486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-94996ef1-c543-44ee-9bfa-d12f39f298bf None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:14.377756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-94996ef1-c543-44ee-9bfa-d12f39f298bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:14.466131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 362/721] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 04:28:14.495483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f96f-4f11-427e-9efc-54b690a24b9a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:14.517334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e47c7d-d7e0-456e-972b-a1e8dcb52c29 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:14.517682 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e47c7d-d7e0-456e-972b-a1e8dcb52c29 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:14.517965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e47c7d-d7e0-456e-972b-a1e8dcb52c29 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:14.519596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 363/722] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:14.537231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90125686-d1cf-4ebc-b08d-70b583692a29 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:14.537500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90125686-d1cf-4ebc-b08d-70b583692a29 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:14.537861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90125686-d1cf-4ebc-b08d-70b583692a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:14.564703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-90125686-d1cf-4ebc-b08d-70b583692a29 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:14.565937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-90125686-d1cf-4ebc-b08d-70b583692a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:14.599676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:14.626605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f96f-4f11-427e-9efc-54b690a24b9a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:14.678047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537f27d-6673-4f44-81f7-bd46b5cf83cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:14.678687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537f27d-6673-4f44-81f7-bd46b5cf83cc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:14.678977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537f27d-6673-4f44-81f7-bd46b5cf83cc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:14.679273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537f27d-6673-4f44-81f7-bd46b5cf83cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:14.690044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 364/723] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:14.696052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537f27d-6673-4f44-81f7-bd46b5cf83cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-2537f27d-6673-4f44-81f7-bd46b5cf83cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:14.701080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:14.701991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:14.702799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 360/724] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:14.708862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90125686-d1cf-4ebc-b08d-70b583692a29 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:14.721217 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537f27d-6673-4f44-81f7-bd46b5cf83cc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:14.728599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:14.879785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90125686-d1cf-4ebc-b08d-70b583692a29 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:14.923438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537f27d-6673-4f44-81f7-bd46b5cf83cc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:14.958358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe694e-38ce-457a-a8bf-382cc463e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:14.958995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe694e-38ce-457a-a8bf-382cc463e752 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:14.959279 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe694e-38ce-457a-a8bf-382cc463e752 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:14.959545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe694e-38ce-457a-a8bf-382cc463e752 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:14.960255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe694e-38ce-457a-a8bf-382cc463e752 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:14.960552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe694e-38ce-457a-a8bf-382cc463e752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:14.961897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe694e-38ce-457a-a8bf-382cc463e752 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:14.974519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094dbcb-c8cb-402b-a1c6-b1f66431b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:14.975200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094dbcb-c8cb-402b-a1c6-b1f66431b94e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:14.975483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094dbcb-c8cb-402b-a1c6-b1f66431b94e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:14.975762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094dbcb-c8cb-402b-a1c6-b1f66431b94e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:14.980971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 365/725] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:14.987289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe694e-38ce-457a-a8bf-382cc463e752 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:15.002538 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094dbcb-c8cb-402b-a1c6-b1f66431b94e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6094dbcb-c8cb-402b-a1c6-b1f66431b94e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:15.009898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:15.010862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:15.012118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:15.013276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 361/726] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:15.021835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094dbcb-c8cb-402b-a1c6-b1f66431b94e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:15.036148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:15.127049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:15.144921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe694e-38ce-457a-a8bf-382cc463e752 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:15.208799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094dbcb-c8cb-402b-a1c6-b1f66431b94e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:15.213795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc613e-8eda-4c2c-83d0-ba02d2f45ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:15.214671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc613e-8eda-4c2c-83d0-ba02d2f45ddd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:15.215174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc613e-8eda-4c2c-83d0-ba02d2f45ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:15.215661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc613e-8eda-4c2c-83d0-ba02d2f45ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:15.243525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc613e-8eda-4c2c-83d0-ba02d2f45ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:15.244975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc613e-8eda-4c2c-83d0-ba02d2f45ddd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:15.262908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e035f0-9ed5-4cba-91d5-85baaa4cd235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:15.263925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e035f0-9ed5-4cba-91d5-85baaa4cd235 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:15.264489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e035f0-9ed5-4cba-91d5-85baaa4cd235 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:15.264960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e035f0-9ed5-4cba-91d5-85baaa4cd235 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:15.265958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e035f0-9ed5-4cba-91d5-85baaa4cd235 None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:15.266456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e035f0-9ed5-4cba-91d5-85baaa4cd235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:15.268107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e035f0-9ed5-4cba-91d5-85baaa4cd235 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-99cc613e-8eda-4c2c-83d0-ba02d2f45ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:15.272601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:15.273448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:15.274344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:15.274344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:15.274344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:15.274344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:15.274344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 366/727] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:15.279667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc613e-8eda-4c2c-83d0-ba02d2f45ddd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:15.280396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 362/728] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:28:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:15.286258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e035f0-9ed5-4cba-91d5-85baaa4cd235 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:15.398641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:15.399873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e035f0-9ed5-4cba-91d5-85baaa4cd235 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:15.426766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:15.439461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ddf63-e233-4f24-9f7d-628d8d54e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:15.440404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ddf63-e233-4f24-9f7d-628d8d54e32d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:15.440882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ddf63-e233-4f24-9f7d-628d8d54e32d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:15.441367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ddf63-e233-4f24-9f7d-628d8d54e32d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:15.456506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ddf63-e233-4f24-9f7d-628d8d54e32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:15.458277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ddf63-e233-4f24-9f7d-628d8d54e32d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-cd8ddf63-e233-4f24-9f7d-628d8d54e32d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:15.475497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:15.476437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:15.477337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:15.477337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:15.477337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:15.477337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:15.479570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 363/729] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:15.484262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc613e-8eda-4c2c-83d0-ba02d2f45ddd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:15.485871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ddf63-e233-4f24-9f7d-628d8d54e32d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:15.584636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eb5f3-2018-4a95-ab0b-fe5e4254b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:15.585264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb5f3-2018-4a95-ab0b-fe5e4254b51c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:15.585548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb5f3-2018-4a95-ab0b-fe5e4254b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:15.585816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb5f3-2018-4a95-ab0b-fe5e4254b51c None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:15.586510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eb5f3-2018-4a95-ab0b-fe5e4254b51c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:15.586807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eb5f3-2018-4a95-ab0b-fe5e4254b51c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:15.588185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eb5f3-2018-4a95-ab0b-fe5e4254b51c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:15.601816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ddf63-e233-4f24-9f7d-628d8d54e32d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:15.618560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 367/730] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:15.623483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eb5f3-2018-4a95-ab0b-fe5e4254b51c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:15.642092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f41e5-fe4c-4d05-bf3b-0f9c9b1bff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:15.643514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f41e5-fe4c-4d05-bf3b-0f9c9b1bff48 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:15.644047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f41e5-fe4c-4d05-bf3b-0f9c9b1bff48 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:15.644515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f41e5-fe4c-4d05-bf3b-0f9c9b1bff48 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:15.645475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f41e5-fe4c-4d05-bf3b-0f9c9b1bff48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:15.645972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f41e5-fe4c-4d05-bf3b-0f9c9b1bff48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:15.647626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f41e5-fe4c-4d05-bf3b-0f9c9b1bff48 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:15.663430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 364/731] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:15.665585 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33c06-cbe3-4a5d-a560-8206bdfc62d7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:15.665886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33c06-cbe3-4a5d-a560-8206bdfc62d7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:15.666155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e33c06-cbe3-4a5d-a560-8206bdfc62d7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:15.671306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 365/732] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:15.673426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc97c-7cfd-48ad-af87-1ff8e9554ee9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:15.673775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc97c-7cfd-48ad-af87-1ff8e9554ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:15.674072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc97c-7cfd-48ad-af87-1ff8e9554ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:15.693281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-da1fc97c-7cfd-48ad-af87-1ff8e9554ee9 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:15.694483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da1fc97c-7cfd-48ad-af87-1ff8e9554ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:15.725463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:15.779191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 366/733] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:15.779191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc97c-7cfd-48ad-af87-1ff8e9554ee9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:15.782736 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eb5f3-2018-4a95-ab0b-fe5e4254b51c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:15.824747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:15.834790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7d6e8-b011-4bb2-a13b-79d061bd4942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:15.835609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7d6e8-b011-4bb2-a13b-79d061bd4942 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:15.835985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7d6e8-b011-4bb2-a13b-79d061bd4942 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:15.836354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7d6e8-b011-4bb2-a13b-79d061bd4942 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:15.844703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7d6e8-b011-4bb2-a13b-79d061bd4942 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:15.846438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7d6e8-b011-4bb2-a13b-79d061bd4942 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d7a7d6e8-b011-4bb2-a13b-79d061bd4942 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:15.859760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:15.860798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:15.861706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:15.866016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 368/734] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:15.866925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7d6e8-b011-4bb2-a13b-79d061bd4942 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:15.906487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc97c-7cfd-48ad-af87-1ff8e9554ee9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:15.946805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc60a-db79-4b70-8784-aa9b06755ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:15.947489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc60a-db79-4b70-8784-aa9b06755ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:15.947767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc60a-db79-4b70-8784-aa9b06755ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:15.948036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc60a-db79-4b70-8784-aa9b06755ee5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:15.956284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afc60a-db79-4b70-8784-aa9b06755ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:15.957802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afc60a-db79-4b70-8784-aa9b06755ee5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a2afc60a-db79-4b70-8784-aa9b06755ee5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:15.969940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:15.971248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 367/735] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:28:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:15.972199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc60a-db79-4b70-8784-aa9b06755ee5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:15.982070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7d6e8-b011-4bb2-a13b-79d061bd4942 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:16.002830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:16.022789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e064752-69cb-4874-a0c6-3a5fbfc575a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:16.023525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e064752-69cb-4874-a0c6-3a5fbfc575a0 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.023875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e064752-69cb-4874-a0c6-3a5fbfc575a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.024155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e064752-69cb-4874-a0c6-3a5fbfc575a0 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.024843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e064752-69cb-4874-a0c6-3a5fbfc575a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:16.026462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e064752-69cb-4874-a0c6-3a5fbfc575a0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:16.047478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 369/736] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:28:15 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:16.048999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a18a-1803-4e48-b2aa-5da61261f0ad None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.049414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a18a-1803-4e48-b2aa-5da61261f0ad None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.049822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a18a-1803-4e48-b2aa-5da61261f0ad None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.051096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 370/737] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:16.051818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a18a-1803-4e48-b2aa-5da61261f0ad None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:16.107404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc60a-db79-4b70-8784-aa9b06755ee5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:16.122656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:16.163960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b526189-32f4-4918-a661-6c02e7d1af74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:16.164977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526189-32f4-4918-a661-6c02e7d1af74 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.165880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526189-32f4-4918-a661-6c02e7d1af74 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.166349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526189-32f4-4918-a661-6c02e7d1af74 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.168069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526189-32f4-4918-a661-6c02e7d1af74 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:16.168672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526189-32f4-4918-a661-6c02e7d1af74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:16.171253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526189-32f4-4918-a661-6c02e7d1af74 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:16.196393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 368/738] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Aug 4 04:28:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:16.197895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129fe2-5a7b-4684-8372-486502dcaaf6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.198098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129fe2-5a7b-4684-8372-486502dcaaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.198373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129fe2-5a7b-4684-8372-486502dcaaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.200669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a18a-1803-4e48-b2aa-5da61261f0ad None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:16.218008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-91129fe2-5a7b-4684-8372-486502dcaaf6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:16.219293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-91129fe2-5a7b-4684-8372-486502dcaaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:16.241261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff78d36-7e2a-42dd-8b84-88e8680e01ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:16.241888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff78d36-7e2a-42dd-8b84-88e8680e01ce None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.242263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff78d36-7e2a-42dd-8b84-88e8680e01ce None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.242540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff78d36-7e2a-42dd-8b84-88e8680e01ce None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.243378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff78d36-7e2a-42dd-8b84-88e8680e01ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:16.243680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff78d36-7e2a-42dd-8b84-88e8680e01ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:16.245222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff78d36-7e2a-42dd-8b84-88e8680e01ce None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:16.263773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 371/739] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Aug 4 04:28:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:16.264587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff78d36-7e2a-42dd-8b84-88e8680e01ce None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:16.297345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 369/740] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:16 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:16.299121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ad413-4526-4d32-9ea1-18a974033d49 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.299407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ad413-4526-4d32-9ea1-18a974033d49 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.299685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ad413-4526-4d32-9ea1-18a974033d49 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.300938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 370/741] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:16.301682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ad413-4526-4d32-9ea1-18a974033d49 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:16.315598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:16.379626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff78d36-7e2a-42dd-8b84-88e8680e01ce None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:16.388272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:16.417075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ad413-4526-4d32-9ea1-18a974033d49 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:16.419716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a77236-46e1-40ce-a010-762b995799ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:16.420407 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a77236-46e1-40ce-a010-762b995799ca None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.420689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a77236-46e1-40ce-a010-762b995799ca None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.420992 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a77236-46e1-40ce-a010-762b995799ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.456346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433fd32-8f56-4593-b30a-52aa255d1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:16.456884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433fd32-8f56-4593-b30a-52aa255d1f65 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.457161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433fd32-8f56-4593-b30a-52aa255d1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.457431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433fd32-8f56-4593-b30a-52aa255d1f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.496194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a77236-46e1-40ce-a010-762b995799ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:16.497786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a77236-46e1-40ce-a010-762b995799ca None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:16.531007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433fd32-8f56-4593-b30a-52aa255d1f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:16.532602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433fd32-8f56-4593-b30a-52aa255d1f65 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:16.618251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 372/742] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:16 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:16.619645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f26fb-b1ce-4c49-b02f-f7cf7401bc81 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.619941 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f26fb-b1ce-4c49-b02f-f7cf7401bc81 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.620220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f26fb-b1ce-4c49-b02f-f7cf7401bc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.633836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:16.641472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-288f26fb-b1ce-4c49-b02f-f7cf7401bc81 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:16.643733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-288f26fb-b1ce-4c49-b02f-f7cf7401bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:16.663494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:16.727687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 373/743] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:16 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 04:28:16.727687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f26fb-b1ce-4c49-b02f-f7cf7401bc81 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:16.770377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 371/744] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:16 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 04:28:16.775704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433fd32-8f56-4593-b30a-52aa255d1f65 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:16.843408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f26fb-b1ce-4c49-b02f-f7cf7401bc81 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:16.878085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9c2f-4a6e-471c-9397-ece58f26e220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:16.878703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9c2f-4a6e-471c-9397-ece58f26e220 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.879000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9c2f-4a6e-471c-9397-ece58f26e220 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.879278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9c2f-4a6e-471c-9397-ece58f26e220 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.879440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433fd32-8f56-4593-b30a-52aa255d1f65 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:16.879963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee9c2f-4a6e-471c-9397-ece58f26e220 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:16.881320 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee9c2f-4a6e-471c-9397-ece58f26e220 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:16.885580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:16.891219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:16.900006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 374/745] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:28:16 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:16.912057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9c2f-4a6e-471c-9397-ece58f26e220 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:16.926674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56108436-65b8-4955-ab5e-2af0df57deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:16.927254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56108436-65b8-4955-ab5e-2af0df57deb8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:16.927607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56108436-65b8-4955-ab5e-2af0df57deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:16.927951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56108436-65b8-4955-ab5e-2af0df57deb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:16.942438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56108436-65b8-4955-ab5e-2af0df57deb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:16.944076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56108436-65b8-4955-ab5e-2af0df57deb8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-56108436-65b8-4955-ab5e-2af0df57deb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:16.961154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:16.962136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:16.963081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:16.963081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:16.963081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:16.963081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:16.967506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 372/746] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:16.968331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56108436-65b8-4955-ab5e-2af0df57deb8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.040703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9c2f-4a6e-471c-9397-ece58f26e220 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.082223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad35c5-64c3-4547-9a0e-1dc2c612b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.082871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad35c5-64c3-4547-9a0e-1dc2c612b9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.083434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad35c5-64c3-4547-9a0e-1dc2c612b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.083943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad35c5-64c3-4547-9a0e-1dc2c612b9a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.089729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56108436-65b8-4955-ab5e-2af0df57deb8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.097642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad35c5-64c3-4547-9a0e-1dc2c612b9a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5cad35c5-64c3-4547-9a0e-1dc2c612b9a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:17.102440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:17.103429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:17.104263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:17.104910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 375/747] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:17.105738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad35c5-64c3-4547-9a0e-1dc2c612b9a6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.146380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c215fd2-1ac1-470f-abc4-77bd2f84be6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.147201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c215fd2-1ac1-470f-abc4-77bd2f84be6f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.147587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c215fd2-1ac1-470f-abc4-77bd2f84be6f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.147861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c215fd2-1ac1-470f-abc4-77bd2f84be6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.163953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c215fd2-1ac1-470f-abc4-77bd2f84be6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:17.165923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c215fd2-1ac1-470f-abc4-77bd2f84be6f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:17.180719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-5c215fd2-1ac1-470f-abc4-77bd2f84be6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:17.189106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:17.190043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:17.190919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:17.190919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:17.190919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:17.190919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:17.191171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 373/748] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:17.191941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c215fd2-1ac1-470f-abc4-77bd2f84be6f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.210883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:17.251883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad35c5-64c3-4547-9a0e-1dc2c612b9a6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.300463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c652be-234f-4b1b-97f3-35c308d0a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.301017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c652be-234f-4b1b-97f3-35c308d0a954 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.301302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c652be-234f-4b1b-97f3-35c308d0a954 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.301595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c652be-234f-4b1b-97f3-35c308d0a954 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.302738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c652be-234f-4b1b-97f3-35c308d0a954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:17.303102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c652be-234f-4b1b-97f3-35c308d0a954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:17.304968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c652be-234f-4b1b-97f3-35c308d0a954 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:17.311738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c215fd2-1ac1-470f-abc4-77bd2f84be6f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.327299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 376/749] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:17.327299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c652be-234f-4b1b-97f3-35c308d0a954 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.354545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d080707-5c83-4f66-b37d-dc63a80c000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.355604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d080707-5c83-4f66-b37d-dc63a80c000b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.356144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d080707-5c83-4f66-b37d-dc63a80c000b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.356630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d080707-5c83-4f66-b37d-dc63a80c000b None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.357545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d080707-5c83-4f66-b37d-dc63a80c000b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:17.358113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d080707-5c83-4f66-b37d-dc63a80c000b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:17.360240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d080707-5c83-4f66-b37d-dc63a80c000b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:17.373965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 374/750] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:17.375190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d080707-5c83-4f66-b37d-dc63a80c000b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.451096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c652be-234f-4b1b-97f3-35c308d0a954 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.467645 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:17.474280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:17.494599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfe253-5af7-4a51-af33-1710b04a0c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.495443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfe253-5af7-4a51-af33-1710b04a0c24 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.495949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfe253-5af7-4a51-af33-1710b04a0c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.496358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfe253-5af7-4a51-af33-1710b04a0c24 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.497247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfe253-5af7-4a51-af33-1710b04a0c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:17.497686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfe253-5af7-4a51-af33-1710b04a0c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:17.499202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfe253-5af7-4a51-af33-1710b04a0c24 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:17.499429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d080707-5c83-4f66-b37d-dc63a80c000b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.516439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 377/751] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:17.517554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfe253-5af7-4a51-af33-1710b04a0c24 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.536871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed45e0-9f7f-4531-ac32-d5e57a51b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.537671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed45e0-9f7f-4531-ac32-d5e57a51b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.538133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed45e0-9f7f-4531-ac32-d5e57a51b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.538322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed45e0-9f7f-4531-ac32-d5e57a51b5c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.545604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed45e0-9f7f-4531-ac32-d5e57a51b5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:17.547501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed45e0-9f7f-4531-ac32-d5e57a51b5c2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-69ed45e0-9f7f-4531-ac32-d5e57a51b5c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:17.560181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:17.561242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:17.562292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:17.562292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:17.562292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:17.562292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:17.562292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:17.562292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:17.562292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:17.562292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:17.562292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 375/752] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:17.562973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed45e0-9f7f-4531-ac32-d5e57a51b5c2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.628654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfe253-5af7-4a51-af33-1710b04a0c24 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.666699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e10185-5744-494b-8f45-9a857e8a466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.667727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10185-5744-494b-8f45-9a857e8a466c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.668179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10185-5744-494b-8f45-9a857e8a466c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.668620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10185-5744-494b-8f45-9a857e8a466c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.680566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e10185-5744-494b-8f45-9a857e8a466c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:17.682333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e10185-5744-494b-8f45-9a857e8a466c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:17.683972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed45e0-9f7f-4531-ac32-d5e57a51b5c2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-41e10185-5744-494b-8f45-9a857e8a466c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:17.697839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:17.698739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:17.699794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:17.699794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:17.699794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:17.699794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:17.701838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 378/753] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:17.703074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e10185-5744-494b-8f45-9a857e8a466c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.718546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:17.725266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251ce2-5d26-4770-b1ad-ac66589d75cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.726094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251ce2-5d26-4770-b1ad-ac66589d75cc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.726380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251ce2-5d26-4770-b1ad-ac66589d75cc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.726653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251ce2-5d26-4770-b1ad-ac66589d75cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.737347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3251ce2-5d26-4770-b1ad-ac66589d75cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:17.739248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3251ce2-5d26-4770-b1ad-ac66589d75cc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:17.743833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a3251ce2-5d26-4770-b1ad-ac66589d75cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:17.754083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:17.754977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:17.755876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:17.755876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:17.755876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:17.755876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:17.755876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:17.755876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:17.755876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:17.755876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:17.763031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 376/754] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:17.763967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251ce2-5d26-4770-b1ad-ac66589d75cc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.834936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e10185-5744-494b-8f45-9a857e8a466c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.877739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fc444-a182-49b9-b6c2-e234dc02680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.878475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fc444-a182-49b9-b6c2-e234dc02680e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.878844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fc444-a182-49b9-b6c2-e234dc02680e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.879246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fc444-a182-49b9-b6c2-e234dc02680e None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.880091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fc444-a182-49b9-b6c2-e234dc02680e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:17.880484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fc444-a182-49b9-b6c2-e234dc02680e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:17.881984 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fc444-a182-49b9-b6c2-e234dc02680e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:17.887831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251ce2-5d26-4770-b1ad-ac66589d75cc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:17.895172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 379/755] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:17.896256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fc444-a182-49b9-b6c2-e234dc02680e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.934977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2bf9d-8c3b-483d-814c-8fd0e1e44fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:17.935893 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2bf9d-8c3b-483d-814c-8fd0e1e44fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:17.936328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2bf9d-8c3b-483d-814c-8fd0e1e44fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:17.936794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2bf9d-8c3b-483d-814c-8fd0e1e44fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:17.937689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2bf9d-8c3b-483d-814c-8fd0e1e44fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:17.938131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2bf9d-8c3b-483d-814c-8fd0e1e44fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:17.940340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2bf9d-8c3b-483d-814c-8fd0e1e44fc0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:17.957320 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 377/756] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:17.958573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2bf9d-8c3b-483d-814c-8fd0e1e44fc0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:17.992785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:18.007646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fc444-a182-49b9-b6c2-e234dc02680e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:18.034655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:18.046865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53203ee-ecf3-42db-b8f2-505ece998ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:18.048043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53203ee-ecf3-42db-b8f2-505ece998ebf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.048321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53203ee-ecf3-42db-b8f2-505ece998ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.048865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53203ee-ecf3-42db-b8f2-505ece998ebf None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.049473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53203ee-ecf3-42db-b8f2-505ece998ebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:18.049787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53203ee-ecf3-42db-b8f2-505ece998ebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:18.051198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53203ee-ecf3-42db-b8f2-505ece998ebf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:18.068881 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 380/757] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:18.069948 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53203ee-ecf3-42db-b8f2-505ece998ebf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:18.097219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2bf9d-8c3b-483d-814c-8fd0e1e44fc0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:18.148064 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e85f-00c8-4b79-917d-58b5b66c9d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:18.148709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e85f-00c8-4b79-917d-58b5b66c9d69 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.148989 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e85f-00c8-4b79-917d-58b5b66c9d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.149255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e85f-00c8-4b79-917d-58b5b66c9d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.150475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530e85f-00c8-4b79-917d-58b5b66c9d69 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=642faef2d1654874bd7205420512998a, user.id=5dcb9d2fbde74819b3848d050299cfe9) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:18.150475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530e85f-00c8-4b79-917d-58b5b66c9d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:18.151825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530e85f-00c8-4b79-917d-58b5b66c9d69 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:18.158048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 378/758] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:17 2022] GET /identity/v3/role_assignments?user.id=5dcb9d2fbde74819b3848d050299cfe9&scope.project.id=642faef2d1654874bd7205420512998a&role.id=c1429555635349208e8b2bd908436746 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:18.159395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e85f-00c8-4b79-917d-58b5b66c9d69 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:18.196805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53203ee-ecf3-42db-b8f2-505ece998ebf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:18.244597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f052fd-508e-4015-910a-924a0a83a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:18.245715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f052fd-508e-4015-910a-924a0a83a722 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.246001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f052fd-508e-4015-910a-924a0a83a722 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.246284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f052fd-508e-4015-910a-924a0a83a722 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.257279 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f052fd-508e-4015-910a-924a0a83a722 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:18.259060 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f052fd-508e-4015-910a-924a0a83a722 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:18.273071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e85f-00c8-4b79-917d-58b5b66c9d69 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-39f052fd-508e-4015-910a-924a0a83a722 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:18.274678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:18.275626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:18.276518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 381/759] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Aug 4 04:28:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:18.278127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e94b-83f3-43a7-8267-19441a7d2d87 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.278505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e94b-83f3-43a7-8267-19441a7d2d87 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.278867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e94b-83f3-43a7-8267-19441a7d2d87 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.280577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 382/760] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:18.281475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e94b-83f3-43a7-8267-19441a7d2d87 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:18.293839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:18.294672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:18.316890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522348da-b8e0-427b-8e8b-59b1d1a6c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:18.317508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522348da-b8e0-427b-8e8b-59b1d1a6c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.317786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522348da-b8e0-427b-8e8b-59b1d1a6c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.318059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522348da-b8e0-427b-8e8b-59b1d1a6c4a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.318851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522348da-b8e0-427b-8e8b-59b1d1a6c4a6 None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=fb129070880846549efcb9925c2736c7) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:18.319186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522348da-b8e0-427b-8e8b-59b1d1a6c4a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:18.320608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522348da-b8e0-427b-8e8b-59b1d1a6c4a6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:18.326204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 379/761] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:18 2022] GET /identity/v3/role_assignments?user.id=fb129070880846549efcb9925c2736c7&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:18.328623 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697012c-64b0-406c-890a-686952099939 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.328916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697012c-64b0-406c-890a-686952099939 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.329186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697012c-64b0-406c-890a-686952099939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.351919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c697012c-64b0-406c-890a-686952099939 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:18.353776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c697012c-64b0-406c-890a-686952099939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:18.422644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e94b-83f3-43a7-8267-19441a7d2d87 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:18.484790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 380/762] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:18.486406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a498e8-d7ae-4b5e-a28c-4cc6c83a030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:18.487089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a498e8-d7ae-4b5e-a28c-4cc6c83a030e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.487424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a498e8-d7ae-4b5e-a28c-4cc6c83a030e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.487699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a498e8-d7ae-4b5e-a28c-4cc6c83a030e None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.488574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a498e8-d7ae-4b5e-a28c-4cc6c83a030e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:18.488883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a498e8-d7ae-4b5e-a28c-4cc6c83a030e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:18.490478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a498e8-d7ae-4b5e-a28c-4cc6c83a030e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:18.510717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 383/763] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Aug 4 04:28:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:18.516536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697012c-64b0-406c-890a-686952099939 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:18.525776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a498e8-d7ae-4b5e-a28c-4cc6c83a030e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:18.653142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:18.691280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a498e8-d7ae-4b5e-a28c-4cc6c83a030e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:18.706053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697012c-64b0-406c-890a-686952099939 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:18.727360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:18.727943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c47f3-4332-4cad-9fc7-b1e88126b454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:18.728590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c47f3-4332-4cad-9fc7-b1e88126b454 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.728880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c47f3-4332-4cad-9fc7-b1e88126b454 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.729154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c47f3-4332-4cad-9fc7-b1e88126b454 None admin] PATH_INFO: `/v3/services/network` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.729789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c47f3-4332-4cad-9fc7-b1e88126b454 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:18.737131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c47f3-4332-4cad-9fc7-b1e88126b454 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6b6c47f3-4332-4cad-9fc7-b1e88126b454 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:18.747062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:18.747998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:18.748802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 384/764] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:18 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:18.758797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c47f3-4332-4cad-9fc7-b1e88126b454 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:18.785381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2a65-30c4-43df-8908-b2882be49d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:18.786031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2a65-30c4-43df-8908-b2882be49d6e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.786314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2a65-30c4-43df-8908-b2882be49d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.786587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2a65-30c4-43df-8908-b2882be49d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.810124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2a65-30c4-43df-8908-b2882be49d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:18.813852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2a65-30c4-43df-8908-b2882be49d6e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-652b2a65-30c4-43df-8908-b2882be49d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:18.848028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:18.848972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:18.849824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:18.849824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:18.849824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:18.849824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:18.849824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 381/765] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:18.854882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2a65-30c4-43df-8908-b2882be49d6e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:18.900528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c47f3-4332-4cad-9fc7-b1e88126b454 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:18.949416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:18.962702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5db9-9f9c-4255-a528-9747affcfca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:18.963530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5db9-9f9c-4255-a528-9747affcfca1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:18.963815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5db9-9f9c-4255-a528-9747affcfca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:18.964087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5db9-9f9c-4255-a528-9747affcfca1 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:18.965104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c5db9-9f9c-4255-a528-9747affcfca1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:18.965412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c5db9-9f9c-4255-a528-9747affcfca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:18.967093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c5db9-9f9c-4255-a528-9747affcfca1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:18.980914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 385/766] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:18.987281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5db9-9f9c-4255-a528-9747affcfca1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:19.081167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2a65-30c4-43df-8908-b2882be49d6e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:19.125131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16e2e7-f31c-4463-b529-c6993fbec43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:19.125755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e2e7-f31c-4463-b529-c6993fbec43b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.126037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e2e7-f31c-4463-b529-c6993fbec43b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.126310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e2e7-f31c-4463-b529-c6993fbec43b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.127022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16e2e7-f31c-4463-b529-c6993fbec43b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:19.127340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16e2e7-f31c-4463-b529-c6993fbec43b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:19.128701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16e2e7-f31c-4463-b529-c6993fbec43b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:19.129565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5db9-9f9c-4255-a528-9747affcfca1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:19.148165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 382/767] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:19.149827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59283a07-2319-4e72-b36d-8e9417f9908f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.150303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59283a07-2319-4e72-b36d-8e9417f9908f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.150795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59283a07-2319-4e72-b36d-8e9417f9908f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.152457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 383/768] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:19.153235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59283a07-2319-4e72-b36d-8e9417f9908f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:19.182058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf4458-5353-46d1-a20a-98f9b50c6c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:19.182938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4458-5353-46d1-a20a-98f9b50c6c76 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.183417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4458-5353-46d1-a20a-98f9b50c6c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.183584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:19.183972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4458-5353-46d1-a20a-98f9b50c6c76 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.184947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4458-5353-46d1-a20a-98f9b50c6c76 None admin] RBAC: Adding query filter params (type=network) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:19.185712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4458-5353-46d1-a20a-98f9b50c6c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:19.187523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4458-5353-46d1-a20a-98f9b50c6c76 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:19.194616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 386/769] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:19.196084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17470139-31ec-4804-b30f-4039835dc146 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.196533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17470139-31ec-4804-b30f-4039835dc146 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.196947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17470139-31ec-4804-b30f-4039835dc146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.217152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-17470139-31ec-4804-b30f-4039835dc146 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:19.218393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-17470139-31ec-4804-b30f-4039835dc146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:19.271967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59283a07-2319-4e72-b36d-8e9417f9908f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:19.288551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:19.308197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048980-e999-4968-bfc1-39f0ea76e235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:19.309050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048980-e999-4968-bfc1-39f0ea76e235 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.309488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048980-e999-4968-bfc1-39f0ea76e235 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.309936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50048980-e999-4968-bfc1-39f0ea76e235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.312327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 387/770] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:19.314150 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17470139-31ec-4804-b30f-4039835dc146 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:19.318441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50048980-e999-4968-bfc1-39f0ea76e235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:19.320164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50048980-e999-4968-bfc1-39f0ea76e235 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-50048980-e999-4968-bfc1-39f0ea76e235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:19.344908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:19.345980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:19.347050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:19.347050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:19.347050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:19.347050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:19.347050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:19.347050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:19.347050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:19.347050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:19.353486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 384/771] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:19.354510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048980-e999-4968-bfc1-39f0ea76e235 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:19.443940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:19.449777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17470139-31ec-4804-b30f-4039835dc146 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:19.464973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50048980-e999-4968-bfc1-39f0ea76e235 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:19.496399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5369293-0545-4f85-8e38-6b25ec2086f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:19.496919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5369293-0545-4f85-8e38-6b25ec2086f9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.497325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5369293-0545-4f85-8e38-6b25ec2086f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.497664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5369293-0545-4f85-8e38-6b25ec2086f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.498644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5369293-0545-4f85-8e38-6b25ec2086f9 None admin] RBAC: Adding query filter params (interface=public, service_id=bc7830412d7249acbe6b7ae64d219e65, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:19.499038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5369293-0545-4f85-8e38-6b25ec2086f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:19.501666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5369293-0545-4f85-8e38-6b25ec2086f9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:19.512264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 388/772] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Aug 4 04:28:19 2022] GET /identity/v3/endpoints?service_id=bc7830412d7249acbe6b7ae64d219e65&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:19.513139 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5369293-0545-4f85-8e38-6b25ec2086f9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:19.513277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75053b7a-db98-438a-bf54-76a90629943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:19.514488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75053b7a-db98-438a-bf54-76a90629943c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.514944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75053b7a-db98-438a-bf54-76a90629943c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.515487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75053b7a-db98-438a-bf54-76a90629943c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.517171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75053b7a-db98-438a-bf54-76a90629943c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:19.519884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75053b7a-db98-438a-bf54-76a90629943c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-75053b7a-db98-438a-bf54-76a90629943c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:19.531943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:19.532873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:28:19.533685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:19.541625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 385/773] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Aug 4 04:28:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:19.541625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75053b7a-db98-438a-bf54-76a90629943c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:19.582581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:19.635752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5369293-0545-4f85-8e38-6b25ec2086f9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:19.648451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75053b7a-db98-438a-bf54-76a90629943c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:19.674246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953f2b2-abe1-4764-ad17-8c62f9174e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:19.675332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953f2b2-abe1-4764-ad17-8c62f9174e20 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.675879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953f2b2-abe1-4764-ad17-8c62f9174e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.676349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953f2b2-abe1-4764-ad17-8c62f9174e20 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.677293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953f2b2-abe1-4764-ad17-8c62f9174e20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:19.677913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953f2b2-abe1-4764-ad17-8c62f9174e20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:19.679684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953f2b2-abe1-4764-ad17-8c62f9174e20 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:19.683709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1ea88-68a5-4137-9aec-234ed814d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:19.684316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ea88-68a5-4137-9aec-234ed814d025 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.684592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ea88-68a5-4137-9aec-234ed814d025 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.684862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ea88-68a5-4137-9aec-234ed814d025 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.685507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1ea88-68a5-4137-9aec-234ed814d025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:19.686884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1ea88-68a5-4137-9aec-234ed814d025 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:19.694052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 386/774] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Aug 4 04:28:19 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:19.698911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1ea88-68a5-4137-9aec-234ed814d025 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:19.699585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 389/775] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:19.700788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953f2b2-abe1-4764-ad17-8c62f9174e20 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:19.709739 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:19.847085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1ea88-68a5-4137-9aec-234ed814d025 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:19.897368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52ebe2-5815-4551-9a5b-14c48fd5c480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:19.897998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52ebe2-5815-4551-9a5b-14c48fd5c480 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.898280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52ebe2-5815-4551-9a5b-14c48fd5c480 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.898557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52ebe2-5815-4551-9a5b-14c48fd5c480 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.899397 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52ebe2-5815-4551-9a5b-14c48fd5c480 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:19.899707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52ebe2-5815-4551-9a5b-14c48fd5c480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:19.901080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52ebe2-5815-4551-9a5b-14c48fd5c480 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:19.901208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953f2b2-abe1-4764-ad17-8c62f9174e20 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:19.907204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 387/776] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Aug 4 04:28:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:19.914912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52ebe2-5815-4551-9a5b-14c48fd5c480 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:19.924581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:19.964310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96fc4-efd3-4196-baef-296b45ddf324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:19.965008 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96fc4-efd3-4196-baef-296b45ddf324 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:19.965292 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96fc4-efd3-4196-baef-296b45ddf324 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:19.965568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea96fc4-efd3-4196-baef-296b45ddf324 None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/bd26e2ac2578438e854d51d8eed26463/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:19.971110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea96fc4-efd3-4196-baef-296b45ddf324 None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=bd26e2ac2578438e854d51d8eed26463, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:19.972559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea96fc4-efd3-4196-baef-296b45ddf324 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:20.011285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 390/777] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:19 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/bd26e2ac2578438e854d51d8eed26463/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:20.027487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:20.061636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52ebe2-5815-4551-9a5b-14c48fd5c480 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:20.100834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda029e-1c2a-43c7-9135-69476052dd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:20.101461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda029e-1c2a-43c7-9135-69476052dd98 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:20.101742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda029e-1c2a-43c7-9135-69476052dd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:20.102015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda029e-1c2a-43c7-9135-69476052dd98 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:20.102703 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda029e-1c2a-43c7-9135-69476052dd98 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:20.103033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda029e-1c2a-43c7-9135-69476052dd98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:20.104395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda029e-1c2a-43c7-9135-69476052dd98 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:20.110517 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 388/778] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Aug 4 04:28:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:20.116351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96fc4-efd3-4196-baef-296b45ddf324 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:20.275556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea96fc4-efd3-4196-baef-296b45ddf324 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:20.326353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9003d9-889c-4b4e-88ef-35922d25fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:20.327372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9003d9-889c-4b4e-88ef-35922d25fb04 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:20.327875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9003d9-889c-4b4e-88ef-35922d25fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:20.328428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9003d9-889c-4b4e-88ef-35922d25fb04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:20.329383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9003d9-889c-4b4e-88ef-35922d25fb04 None admin] RBAC: Adding query filter params (interface=public, service_id=026993fdeccb4a1db8b61bc723ccc067, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:20.329914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9003d9-889c-4b4e-88ef-35922d25fb04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:20.331581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9003d9-889c-4b4e-88ef-35922d25fb04 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:20.340535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 391/779] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Aug 4 04:28:20 2022] GET /identity/v3/endpoints?service_id=026993fdeccb4a1db8b61bc723ccc067&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:20.346884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda029e-1c2a-43c7-9135-69476052dd98 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:20.480474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda029e-1c2a-43c7-9135-69476052dd98 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:20.519867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738764ab-fd67-4eee-bcdf-7f3a7786ed2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:20.520491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738764ab-fd67-4eee-bcdf-7f3a7786ed2e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:20.520752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738764ab-fd67-4eee-bcdf-7f3a7786ed2e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:20.521016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738764ab-fd67-4eee-bcdf-7f3a7786ed2e None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:20.521669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738764ab-fd67-4eee-bcdf-7f3a7786ed2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:20.523068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738764ab-fd67-4eee-bcdf-7f3a7786ed2e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:20.529269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 389/780] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Aug 4 04:28:20 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:20.567493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125f899-7d0b-4323-b8a8-6d476cb261cc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:20.568407 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125f899-7d0b-4323-b8a8-6d476cb261cc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:20.568857 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125f899-7d0b-4323-b8a8-6d476cb261cc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:20.570604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 392/781] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:20.583647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9b070-dee0-42a8-a2f1-c2d4f18a37a2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:20.584000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9b070-dee0-42a8-a2f1-c2d4f18a37a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:20.584204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9b070-dee0-42a8-a2f1-c2d4f18a37a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:20.591739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858d988-a0de-4ba7-a7eb-130e8afdebe8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:20.592034 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858d988-a0de-4ba7-a7eb-130e8afdebe8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:20.592299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858d988-a0de-4ba7-a7eb-130e8afdebe8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:20.594305 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:20.594527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 393/782] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:20.600100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74acac5-42de-4859-bff1-41f8f5bbb196 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:20.600386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74acac5-42de-4859-bff1-41f8f5bbb196 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:20.600665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74acac5-42de-4859-bff1-41f8f5bbb196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:20.612865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-75e9b070-dee0-42a8-a2f1-c2d4f18a37a2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:20.614095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-75e9b070-dee0-42a8-a2f1-c2d4f18a37a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:20.622060 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b74acac5-42de-4859-bff1-41f8f5bbb196 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:20.626484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b74acac5-42de-4859-bff1-41f8f5bbb196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:20.700764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:20.748818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 390/783] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:20.760951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 394/784] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:20.773270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9b070-dee0-42a8-a2f1-c2d4f18a37a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:20.783316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74acac5-42de-4859-bff1-41f8f5bbb196 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:20.907009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74acac5-42de-4859-bff1-41f8f5bbb196 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:20.943299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f2cb4-41ad-4109-93be-ee99c2b1926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:20.943299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2cb4-41ad-4109-93be-ee99c2b1926a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:20.943299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2cb4-41ad-4109-93be-ee99c2b1926a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:20.943299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2cb4-41ad-4109-93be-ee99c2b1926a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:20.946748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9b070-dee0-42a8-a2f1-c2d4f18a37a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:20.950106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f2cb4-41ad-4109-93be-ee99c2b1926a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e04f2cb4-41ad-4109-93be-ee99c2b1926a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:20.962178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:20.963363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:20.964389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 395/785] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:20.966359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f2cb4-41ad-4109-93be-ee99c2b1926a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:20.996252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:21.044126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:21.058473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c66f-c44d-4168-84f5-edb84f79a4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:21.059158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c66f-c44d-4168-84f5-edb84f79a4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:21.059440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c66f-c44d-4168-84f5-edb84f79a4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:21.059711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c66f-c44d-4168-84f5-edb84f79a4c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:21.076438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f2cb4-41ad-4109-93be-ee99c2b1926a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:21.088002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c66f-c44d-4168-84f5-edb84f79a4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0033c66f-c44d-4168-84f5-edb84f79a4c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:21.101822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:21.104040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:21.106066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 391/786] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:21.111014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c66f-c44d-4168-84f5-edb84f79a4c4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:21.113173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580716-c56f-40c8-8852-7390ce4f7daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:21.113794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580716-c56f-40c8-8852-7390ce4f7daf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:21.114075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580716-c56f-40c8-8852-7390ce4f7daf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:21.114352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580716-c56f-40c8-8852-7390ce4f7daf None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:21.115163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580716-c56f-40c8-8852-7390ce4f7daf None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:21.115468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580716-c56f-40c8-8852-7390ce4f7daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:21.116896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580716-c56f-40c8-8852-7390ce4f7daf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:21.126697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 396/787] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:28:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:21.132074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580716-c56f-40c8-8852-7390ce4f7daf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:21.228518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:21.243287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580716-c56f-40c8-8852-7390ce4f7daf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:21.298040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c66f-c44d-4168-84f5-edb84f79a4c4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:21.303715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbba899-8d05-46c0-90ef-a36e4780cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:21.304379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbba899-8d05-46c0-90ef-a36e4780cb93 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:21.304666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbba899-8d05-46c0-90ef-a36e4780cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:21.305018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbba899-8d05-46c0-90ef-a36e4780cb93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:21.329869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbba899-8d05-46c0-90ef-a36e4780cb93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:21.331349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbba899-8d05-46c0-90ef-a36e4780cb93 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:21.344331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e31f6-4975-4bce-8de2-6c8ad671110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:21.345064 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e31f6-4975-4bce-8de2-6c8ad671110b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:21.345405 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e31f6-4975-4bce-8de2-6c8ad671110b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:21.345681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e31f6-4975-4bce-8de2-6c8ad671110b None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:21.346414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e31f6-4975-4bce-8de2-6c8ad671110b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3dbba899-8d05-46c0-90ef-a36e4780cb93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:21.346640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:21.347501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:21.348364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:21.348364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:21.348364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:21.348364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:21.348587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e31f6-4975-4bce-8de2-6c8ad671110b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:21.348587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e31f6-4975-4bce-8de2-6c8ad671110b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:21.348707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 397/788] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:21.353625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbba899-8d05-46c0-90ef-a36e4780cb93 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:21.358235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 392/789] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:21.364345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e31f6-4975-4bce-8de2-6c8ad671110b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:21.423835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:21.472469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e31f6-4975-4bce-8de2-6c8ad671110b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:21.511000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232218-54a5-41b0-9ec7-bbadbd7aeea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:21.511910 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232218-54a5-41b0-9ec7-bbadbd7aeea3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:21.512332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232218-54a5-41b0-9ec7-bbadbd7aeea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:21.512744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232218-54a5-41b0-9ec7-bbadbd7aeea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:21.524990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da232218-54a5-41b0-9ec7-bbadbd7aeea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:21.527525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da232218-54a5-41b0-9ec7-bbadbd7aeea3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-da232218-54a5-41b0-9ec7-bbadbd7aeea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:21.543296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:21.544345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:21.545519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:21.545519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:21.545519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:21.545519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:21.548554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 393/790] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:21.556907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232218-54a5-41b0-9ec7-bbadbd7aeea3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:21.588949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbba899-8d05-46c0-90ef-a36e4780cb93 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:21.673912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232218-54a5-41b0-9ec7-bbadbd7aeea3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:21.693259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:21.711963 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588dd3c-34b7-4373-9b14-25c456e219cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:21.712803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588dd3c-34b7-4373-9b14-25c456e219cc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:21.713227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588dd3c-34b7-4373-9b14-25c456e219cc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:21.713668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588dd3c-34b7-4373-9b14-25c456e219cc None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:21.714499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588dd3c-34b7-4373-9b14-25c456e219cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:21.714941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588dd3c-34b7-4373-9b14-25c456e219cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:21.716457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588dd3c-34b7-4373-9b14-25c456e219cc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:21.719354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3f9fe-e777-4e53-8281-18760ee339ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:21.719992 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f9fe-e777-4e53-8281-18760ee339ad None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:21.720248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f9fe-e777-4e53-8281-18760ee339ad None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:21.720524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3f9fe-e777-4e53-8281-18760ee339ad None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:21.721218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3f9fe-e777-4e53-8281-18760ee339ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:21.721527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3f9fe-e777-4e53-8281-18760ee339ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:21.722887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3f9fe-e777-4e53-8281-18760ee339ad None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:21.730779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 394/791] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:21.745063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588dd3c-34b7-4373-9b14-25c456e219cc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:21.757049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:21.763774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 398/792] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:21.767401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3f9fe-e777-4e53-8281-18760ee339ad None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:21.952578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588dd3c-34b7-4373-9b14-25c456e219cc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:21.989446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630125-27b3-43fd-b1d6-4efc98a3fa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:21.990221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630125-27b3-43fd-b1d6-4efc98a3fa90 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:21.990505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630125-27b3-43fd-b1d6-4efc98a3fa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:21.990778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630125-27b3-43fd-b1d6-4efc98a3fa90 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:21.998539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59630125-27b3-43fd-b1d6-4efc98a3fa90 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.000776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59630125-27b3-43fd-b1d6-4efc98a3fa90 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-59630125-27b3-43fd-b1d6-4efc98a3fa90 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:22.013811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:22.014751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:22.015752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:22.019749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 395/793] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:22.021406 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630125-27b3-43fd-b1d6-4efc98a3fa90 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:22.037756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3f9fe-e777-4e53-8281-18760ee339ad None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:22.055691 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:22.133540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630125-27b3-43fd-b1d6-4efc98a3fa90 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:22.163785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b4590-86b8-4ba5-a9af-27bd9dabe895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:22.164602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b4590-86b8-4ba5-a9af-27bd9dabe895 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.164980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b4590-86b8-4ba5-a9af-27bd9dabe895 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.165352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b4590-86b8-4ba5-a9af-27bd9dabe895 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.169160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2cef8-61c2-41a9-98e1-2a9075f229c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:22.170267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2cef8-61c2-41a9-98e1-2a9075f229c7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.170551 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2cef8-61c2-41a9-98e1-2a9075f229c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.170877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2cef8-61c2-41a9-98e1-2a9075f229c7 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.171714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2cef8-61c2-41a9-98e1-2a9075f229c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:22.172778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2cef8-61c2-41a9-98e1-2a9075f229c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.174287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2cef8-61c2-41a9-98e1-2a9075f229c7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.188469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b4590-86b8-4ba5-a9af-27bd9dabe895 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.190045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b4590-86b8-4ba5-a9af-27bd9dabe895 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.193545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 396/794] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:22.198932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2cef8-61c2-41a9-98e1-2a9075f229c7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-608b4590-86b8-4ba5-a9af-27bd9dabe895 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:22.224414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:22.225362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:22.226293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 399/795] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:28:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:22.235959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b4590-86b8-4ba5-a9af-27bd9dabe895 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:22.306193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:22.310920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:22.323767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2cef8-61c2-41a9-98e1-2a9075f229c7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:22.364332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b4590-86b8-4ba5-a9af-27bd9dabe895 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:22.370046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3145059-1be8-4086-888d-d9d3c87e67fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:22.370943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145059-1be8-4086-888d-d9d3c87e67fc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.371491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145059-1be8-4086-888d-d9d3c87e67fc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.372431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145059-1be8-4086-888d-d9d3c87e67fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.388211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3145059-1be8-4086-888d-d9d3c87e67fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.391449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3145059-1be8-4086-888d-d9d3c87e67fc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.404946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113b019-ca2f-4e8e-a75a-104ce1f8144f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:22.405712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b019-ca2f-4e8e-a75a-104ce1f8144f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.406075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b019-ca2f-4e8e-a75a-104ce1f8144f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.406389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b019-ca2f-4e8e-a75a-104ce1f8144f None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.407437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113b019-ca2f-4e8e-a75a-104ce1f8144f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:22.407835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113b019-ca2f-4e8e-a75a-104ce1f8144f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.409283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113b019-ca2f-4e8e-a75a-104ce1f8144f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d3145059-1be8-4086-888d-d9d3c87e67fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:22.413878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:22.414750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:22.415655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:22.415655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:22.415655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:22.415655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:22.416646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 397/796] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:22.417527 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d659273-300a-4925-a569-6b7c941b81bd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.417816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d659273-300a-4925-a569-6b7c941b81bd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.418093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d659273-300a-4925-a569-6b7c941b81bd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.423124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 398/797] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:22.423124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d659273-300a-4925-a569-6b7c941b81bd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:22.439768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 400/798] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:22.441250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7238e-54df-4f4f-b04b-a0c6ff607f1a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.441672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7238e-54df-4f4f-b04b-a0c6ff607f1a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.442134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7238e-54df-4f4f-b04b-a0c6ff607f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.460825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6bb7238e-54df-4f4f-b04b-a0c6ff607f1a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:22.462263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6bb7238e-54df-4f4f-b04b-a0c6ff607f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:22.539230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 401/799] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:22.540374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7238e-54df-4f4f-b04b-a0c6ff607f1a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:22.543081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d659273-300a-4925-a569-6b7c941b81bd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:22.583382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814853c-e70d-435f-8f5a-c843a79872e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:22.583916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814853c-e70d-435f-8f5a-c843a79872e2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.584316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814853c-e70d-435f-8f5a-c843a79872e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.584664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814853c-e70d-435f-8f5a-c843a79872e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.585431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814853c-e70d-435f-8f5a-c843a79872e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:22.585810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814853c-e70d-435f-8f5a-c843a79872e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.587368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814853c-e70d-435f-8f5a-c843a79872e2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.590309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:22.607017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 399/800] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:22.607017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814853c-e70d-435f-8f5a-c843a79872e2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:22.619457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:22.674119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7238e-54df-4f4f-b04b-a0c6ff607f1a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:22.712016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fe457-6fc3-49a6-94ad-9f3d72ce13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:22.712999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fe457-6fc3-49a6-94ad-9f3d72ce13cb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.713423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fe457-6fc3-49a6-94ad-9f3d72ce13cb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.713841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fe457-6fc3-49a6-94ad-9f3d72ce13cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.719473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814853c-e70d-435f-8f5a-c843a79872e2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:22.725860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fe457-6fc3-49a6-94ad-9f3d72ce13cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.727616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fe457-6fc3-49a6-94ad-9f3d72ce13cb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-658fe457-6fc3-49a6-94ad-9f3d72ce13cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:22.744644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:22.745889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:22.746952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:22.746952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:22.746952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:22.746952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:22.749389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 402/801] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:22.750490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fe457-6fc3-49a6-94ad-9f3d72ce13cb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:22.767257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdbd81-90d7-4762-b1f8-a000d1e9ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:22.767905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdbd81-90d7-4762-b1f8-a000d1e9ab9b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.768222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdbd81-90d7-4762-b1f8-a000d1e9ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.768503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdbd81-90d7-4762-b1f8-a000d1e9ab9b None admin] PATH_INFO: `/v3/services/network` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.769192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdbd81-90d7-4762-b1f8-a000d1e9ab9b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.770966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdbd81-90d7-4762-b1f8-a000d1e9ab9b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-68cdbd81-90d7-4762-b1f8-a000d1e9ab9b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:22.780951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:22.782676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:22.788443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 400/802] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:22.789278 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdbd81-90d7-4762-b1f8-a000d1e9ab9b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:22.846824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:22.864211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:22.867237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fe457-6fc3-49a6-94ad-9f3d72ce13cb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:22.888635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdbd81-90d7-4762-b1f8-a000d1e9ab9b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:22.901401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949bd3a-4198-41cc-ad10-12e47ab45581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:22.902059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949bd3a-4198-41cc-ad10-12e47ab45581 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.902337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949bd3a-4198-41cc-ad10-12e47ab45581 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.902606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949bd3a-4198-41cc-ad10-12e47ab45581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.909661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949bd3a-4198-41cc-ad10-12e47ab45581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.911106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949bd3a-4198-41cc-ad10-12e47ab45581 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6949bd3a-4198-41cc-ad10-12e47ab45581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:22.922639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:22.923606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:22.924495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:22.924495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:22.924495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:22.924495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:22.924495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:22.924495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:22.924495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:22.924495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:22.924922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0d14b-c457-4967-a0e4-8909d8ce0e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:22.925017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 403/803] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:22.925094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d14b-c457-4967-a0e4-8909d8ce0e3d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.925094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d14b-c457-4967-a0e4-8909d8ce0e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.925094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d14b-c457-4967-a0e4-8909d8ce0e3d None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.925291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456ee27-34b3-48f8-aeef-a7d3d088f9b7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.925291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456ee27-34b3-48f8-aeef-a7d3d088f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.925422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456ee27-34b3-48f8-aeef-a7d3d088f9b7 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.925495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0d14b-c457-4967-a0e4-8909d8ce0e3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:22.926112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0d14b-c457-4967-a0e4-8909d8ce0e3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:22.926776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 404/804] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:22.927323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456ee27-34b3-48f8-aeef-a7d3d088f9b7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:22.931186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0d14b-c457-4967-a0e4-8909d8ce0e3d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:22.945460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 401/805] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:22.946887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc8915-e06c-4c71-9990-620ab63bf435 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:22.947251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc8915-e06c-4c71-9990-620ab63bf435 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:22.947526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc8915-e06c-4c71-9990-620ab63bf435 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:22.951370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 402/806] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:22.951370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc8915-e06c-4c71-9990-620ab63bf435 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.041288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456ee27-34b3-48f8-aeef-a7d3d088f9b7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:23.050339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc8915-e06c-4c71-9990-620ab63bf435 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:23.070706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:23.075223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfd26c-ce81-4719-ba43-a759b21a8f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:23.076022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfd26c-ce81-4719-ba43-a759b21a8f5e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.076314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfd26c-ce81-4719-ba43-a759b21a8f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.076559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfd26c-ce81-4719-ba43-a759b21a8f5e None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.077251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfd26c-ce81-4719-ba43-a759b21a8f5e None admin] RBAC: Adding query filter params (name=network) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:23.077607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfd26c-ce81-4719-ba43-a759b21a8f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:23.079537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfd26c-ce81-4719-ba43-a759b21a8f5e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:23.084430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 405/807] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:23.085551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2a578-5f11-4edd-b56f-333f96a44501 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.085835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2a578-5f11-4edd-b56f-333f96a44501 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.086102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2a578-5f11-4edd-b56f-333f96a44501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.089810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd972f-c198-4820-85eb-434dfcbc4933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:23.090449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd972f-c198-4820-85eb-434dfcbc4933 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.090727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd972f-c198-4820-85eb-434dfcbc4933 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.091008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd972f-c198-4820-85eb-434dfcbc4933 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.091782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd972f-c198-4820-85eb-434dfcbc4933 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:23.092077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd972f-c198-4820-85eb-434dfcbc4933 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:23.093481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd972f-c198-4820-85eb-434dfcbc4933 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:23.104111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8af2a578-5f11-4edd-b56f-333f96a44501 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:23.105061 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 403/808] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:23.105289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8af2a578-5f11-4edd-b56f-333f96a44501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:23.105850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd972f-c198-4820-85eb-434dfcbc4933 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.123129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:23.176044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 406/809] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:23.177283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cfd68-0401-4ad5-88a5-17d4db2c7c8e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.177568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cfd68-0401-4ad5-88a5-17d4db2c7c8e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.177847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cfd68-0401-4ad5-88a5-17d4db2c7c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.195134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-391cfd68-0401-4ad5-88a5-17d4db2c7c8e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:23.196305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-391cfd68-0401-4ad5-88a5-17d4db2c7c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:23.213608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd972f-c198-4820-85eb-434dfcbc4933 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:23.255692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de8475-8ee9-418c-96b0-00dc231d67af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:23.256329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8475-8ee9-418c-96b0-00dc231d67af None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.256615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8475-8ee9-418c-96b0-00dc231d67af None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.256892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8475-8ee9-418c-96b0-00dc231d67af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.263539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de8475-8ee9-418c-96b0-00dc231d67af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:23.264973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de8475-8ee9-418c-96b0-00dc231d67af None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:23.269299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 407/810] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:23.270161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cfd68-0401-4ad5-88a5-17d4db2c7c8e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-19de8475-8ee9-418c-96b0-00dc231d67af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:23.276903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:23.278222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 404/811] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:23.280030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de8475-8ee9-418c-96b0-00dc231d67af None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.329457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:23.359227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:23.375853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cfd68-0401-4ad5-88a5-17d4db2c7c8e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:23.387697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de8475-8ee9-418c-96b0-00dc231d67af None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:23.410048 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd59719-a006-482f-ae8f-7b2be9861f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:23.410666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd59719-a006-482f-ae8f-7b2be9861f56 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.410946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd59719-a006-482f-ae8f-7b2be9861f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.411250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd59719-a006-482f-ae8f-7b2be9861f56 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.411921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd59719-a006-482f-ae8f-7b2be9861f56 None admin] RBAC: Adding query filter params (type=network) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:23.412229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd59719-a006-482f-ae8f-7b2be9861f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:23.413591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd59719-a006-482f-ae8f-7b2be9861f56 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:23.418271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 408/812] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:23.419064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd59719-a006-482f-ae8f-7b2be9861f56 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.421619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05c82c-4d82-4a23-9ac9-46494b7d6d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:23.423308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05c82c-4d82-4a23-9ac9-46494b7d6d3d None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.423308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05c82c-4d82-4a23-9ac9-46494b7d6d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.423583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05c82c-4d82-4a23-9ac9-46494b7d6d3d None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/5dcb9d2fbde74819b3848d050299cfe9/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.425505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05c82c-4d82-4a23-9ac9-46494b7d6d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=5dcb9d2fbde74819b3848d050299cfe9, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:23.426918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05c82c-4d82-4a23-9ac9-46494b7d6d3d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:23.440109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 405/813] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:23 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/5dcb9d2fbde74819b3848d050299cfe9/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:23.440901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05c82c-4d82-4a23-9ac9-46494b7d6d3d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.538455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd59719-a006-482f-ae8f-7b2be9861f56 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:23.574465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:23.579389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9d133-2fa1-4e55-b1b5-5a5e29c03b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:23.579660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05c82c-4d82-4a23-9ac9-46494b7d6d3d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:23.580055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9d133-2fa1-4e55-b1b5-5a5e29c03b9c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.580337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9d133-2fa1-4e55-b1b5-5a5e29c03b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.580611 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9d133-2fa1-4e55-b1b5-5a5e29c03b9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.600008 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9d133-2fa1-4e55-b1b5-5a5e29c03b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-91e9d133-2fa1-4e55-b1b5-5a5e29c03b9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:23.608909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:23.611114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:23.611946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 409/814] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:23.613661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9d133-2fa1-4e55-b1b5-5a5e29c03b9c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.627722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:23.652376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912d32-e2f5-4392-877c-3123ee9af751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:23.653002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912d32-e2f5-4392-877c-3123ee9af751 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.653286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912d32-e2f5-4392-877c-3123ee9af751 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.653558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912d32-e2f5-4392-877c-3123ee9af751 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.654314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79912d32-e2f5-4392-877c-3123ee9af751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:23.654618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79912d32-e2f5-4392-877c-3123ee9af751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:23.656073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79912d32-e2f5-4392-877c-3123ee9af751 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:23.668629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 406/815] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:23.669435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912d32-e2f5-4392-877c-3123ee9af751 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.745539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9d133-2fa1-4e55-b1b5-5a5e29c03b9c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:23.784997 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912d32-e2f5-4392-877c-3123ee9af751 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:23.785950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40f9de-3eee-4aa0-9221-d9abd24747df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:23.786603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40f9de-3eee-4aa0-9221-d9abd24747df None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.786881 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40f9de-3eee-4aa0-9221-d9abd24747df None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.787190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40f9de-3eee-4aa0-9221-d9abd24747df None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.788247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40f9de-3eee-4aa0-9221-d9abd24747df None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:23.789163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40f9de-3eee-4aa0-9221-d9abd24747df None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9c40f9de-3eee-4aa0-9221-d9abd24747df None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:23.798521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:23.799483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:23.800303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 410/816] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Aug 4 04:28:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:23.801278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40f9de-3eee-4aa0-9221-d9abd24747df None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.833415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db274410-55d6-4d90-bd8f-6c2e4587edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:23.833960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db274410-55d6-4d90-bd8f-6c2e4587edfc None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:23.834255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db274410-55d6-4d90-bd8f-6c2e4587edfc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:23.834495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db274410-55d6-4d90-bd8f-6c2e4587edfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:23.835236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db274410-55d6-4d90-bd8f-6c2e4587edfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:23.836599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db274410-55d6-4d90-bd8f-6c2e4587edfc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:23.859236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 407/817] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:28:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:23.860045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db274410-55d6-4d90-bd8f-6c2e4587edfc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:23.887772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:23.903247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:23.944381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40f9de-3eee-4aa0-9221-d9abd24747df None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:24.012021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3254fe-279d-45de-8a92-ac0f9c358910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:24.012666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3254fe-279d-45de-8a92-ac0f9c358910 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:24.012945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3254fe-279d-45de-8a92-ac0f9c358910 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:24.013218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3254fe-279d-45de-8a92-ac0f9c358910 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:24.013956 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3254fe-279d-45de-8a92-ac0f9c358910 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:24.014289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3254fe-279d-45de-8a92-ac0f9c358910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:24.016438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3254fe-279d-45de-8a92-ac0f9c358910 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:24.027237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 411/818] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:24.028152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3254fe-279d-45de-8a92-ac0f9c358910 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:24.028553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db274410-55d6-4d90-bd8f-6c2e4587edfc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:24.078280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec690ff-76f1-46d7-a674-3e08b0a83818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:24.079513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec690ff-76f1-46d7-a674-3e08b0a83818 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:24.080000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec690ff-76f1-46d7-a674-3e08b0a83818 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:24.080528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec690ff-76f1-46d7-a674-3e08b0a83818 None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/fb129070880846549efcb9925c2736c7/roles/e1668813c1fa4ab5af30b933fa7ee73e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:24.099851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec690ff-76f1-46d7-a674-3e08b0a83818 None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=fb129070880846549efcb9925c2736c7, role_id=e1668813c1fa4ab5af30b933fa7ee73e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:24.101569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec690ff-76f1-46d7-a674-3e08b0a83818 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:24.118213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 408/819] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:23 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/fb129070880846549efcb9925c2736c7/roles/e1668813c1fa4ab5af30b933fa7ee73e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:24.119118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec690ff-76f1-46d7-a674-3e08b0a83818 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:24.161650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3254fe-279d-45de-8a92-ac0f9c358910 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:24.201647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:24.209972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64e2d4-282a-4d69-a559-40b7a5332a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:24.210604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64e2d4-282a-4d69-a559-40b7a5332a52 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:24.210889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64e2d4-282a-4d69-a559-40b7a5332a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:24.211206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64e2d4-282a-4d69-a559-40b7a5332a52 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:24.211901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64e2d4-282a-4d69-a559-40b7a5332a52 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:24.212209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64e2d4-282a-4d69-a559-40b7a5332a52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:24.213615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64e2d4-282a-4d69-a559-40b7a5332a52 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:24.219441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 412/820] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Aug 4 04:28:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:24.225422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:24.225632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64e2d4-282a-4d69-a559-40b7a5332a52 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:24.276148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec690ff-76f1-46d7-a674-3e08b0a83818 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:24.331013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437960b0-052e-4812-a5bd-da24c20bb9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:24.331013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437960b0-052e-4812-a5bd-da24c20bb9ee None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:24.331013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437960b0-052e-4812-a5bd-da24c20bb9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:24.331013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437960b0-052e-4812-a5bd-da24c20bb9ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:24.341027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437960b0-052e-4812-a5bd-da24c20bb9ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:24.342489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437960b0-052e-4812-a5bd-da24c20bb9ee None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:24.348853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64e2d4-282a-4d69-a559-40b7a5332a52 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-437960b0-052e-4812-a5bd-da24c20bb9ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:24.362258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:24.363244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:24.364135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:24.364135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:24.364135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:24.364135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:24.364135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 409/821] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:24.370141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437960b0-052e-4812-a5bd-da24c20bb9ee None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:24.402494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc500-d02f-45aa-8a6a-94b1e6b5d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:24.403860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc500-d02f-45aa-8a6a-94b1e6b5d76b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:24.404821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc500-d02f-45aa-8a6a-94b1e6b5d76b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:24.405403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc500-d02f-45aa-8a6a-94b1e6b5d76b None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:24.407189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efc500-d02f-45aa-8a6a-94b1e6b5d76b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:24.408164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efc500-d02f-45aa-8a6a-94b1e6b5d76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:24.410351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efc500-d02f-45aa-8a6a-94b1e6b5d76b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:24.418034 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 413/822] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Aug 4 04:28:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:24.425402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc500-d02f-45aa-8a6a-94b1e6b5d76b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:24.497660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:24.498674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437960b0-052e-4812-a5bd-da24c20bb9ee None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:24.518150 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:24.541798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905619b-723e-4437-b435-1d550d404e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:24.543147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905619b-723e-4437-b435-1d550d404e2f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:24.543749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905619b-723e-4437-b435-1d550d404e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:24.544195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905619b-723e-4437-b435-1d550d404e2f None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:24.545213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905619b-723e-4437-b435-1d550d404e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:24.546010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905619b-723e-4437-b435-1d550d404e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:24.548867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905619b-723e-4437-b435-1d550d404e2f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:24.552155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc500-d02f-45aa-8a6a-94b1e6b5d76b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:24.569038 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 410/823] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:24.570255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905619b-723e-4437-b435-1d550d404e2f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:24.599835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51903e5-6234-4f46-a373-6fe0bdfffd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:24.600463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51903e5-6234-4f46-a373-6fe0bdfffd8d None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:24.600797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51903e5-6234-4f46-a373-6fe0bdfffd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:24.601077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51903e5-6234-4f46-a373-6fe0bdfffd8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:24.601801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51903e5-6234-4f46-a373-6fe0bdfffd8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:24.603264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51903e5-6234-4f46-a373-6fe0bdfffd8d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:24.635160 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 414/824] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:28:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:28:24.716453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905619b-723e-4437-b435-1d550d404e2f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:24.772841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adcf5d-4fe3-4fcf-bf52-42942a52b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:24.773965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adcf5d-4fe3-4fcf-bf52-42942a52b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:24.774480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adcf5d-4fe3-4fcf-bf52-42942a52b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:24.775040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adcf5d-4fe3-4fcf-bf52-42942a52b7a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:24.783696 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adcf5d-4fe3-4fcf-bf52-42942a52b7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:24.785513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adcf5d-4fe3-4fcf-bf52-42942a52b7a7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-08adcf5d-4fe3-4fcf-bf52-42942a52b7a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:24.801564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:24.802496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:24.803456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:24.806017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 411/825] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Aug 4 04:28:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:24.812905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51903e5-6234-4f46-a373-6fe0bdfffd8d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:24.920899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51903e5-6234-4f46-a373-6fe0bdfffd8d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:24.936655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:24.960629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540bd7-6871-4beb-a1e3-a3d644f4e709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:24.961609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540bd7-6871-4beb-a1e3-a3d644f4e709 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:24.962082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540bd7-6871-4beb-a1e3-a3d644f4e709 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:24.962542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540bd7-6871-4beb-a1e3-a3d644f4e709 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:24.963853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3540bd7-6871-4beb-a1e3-a3d644f4e709 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:24.964369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3540bd7-6871-4beb-a1e3-a3d644f4e709 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:24.966144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3540bd7-6871-4beb-a1e3-a3d644f4e709 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:24.985558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 415/826] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Aug 4 04:28:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:24.991407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adcf5d-4fe3-4fcf-bf52-42942a52b7a7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:25.041328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:25.120451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adcf5d-4fe3-4fcf-bf52-42942a52b7a7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:25.157972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4bfa9-c939-4b6e-a758-0d7007dd62fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:25.159066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4bfa9-c939-4b6e-a758-0d7007dd62fb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:25.159544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4bfa9-c939-4b6e-a758-0d7007dd62fb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:25.160095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4bfa9-c939-4b6e-a758-0d7007dd62fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:25.235008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4bfa9-c939-4b6e-a758-0d7007dd62fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:25.236894 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4bfa9-c939-4b6e-a758-0d7007dd62fb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:25.272976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:25.351914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 412/827] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:25.359866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540bd7-6871-4beb-a1e3-a3d644f4e709 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:25.474978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540bd7-6871-4beb-a1e3-a3d644f4e709 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:25.512137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2853c3-fef8-4860-b200-298db30006a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:25.513336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2853c3-fef8-4860-b200-298db30006a5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:25.513838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2853c3-fef8-4860-b200-298db30006a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:25.514307 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2853c3-fef8-4860-b200-298db30006a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:25.523057 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8e86b-be96-42c9-8a7c-10913af92b77 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:25.524096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8e86b-be96-42c9-8a7c-10913af92b77 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:25.524653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8e86b-be96-42c9-8a7c-10913af92b77 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:25.527518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2853c3-fef8-4860-b200-298db30006a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:25.527761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 413/828] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:25.531550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2853c3-fef8-4860-b200-298db30006a5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:25.534679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277135c-ccdc-4017-a841-734e0fc0bd5c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:25.535063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277135c-ccdc-4017-a841-734e0fc0bd5c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:25.535420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277135c-ccdc-4017-a841-734e0fc0bd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4c2853c3-fef8-4860-b200-298db30006a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:25.549370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:25.550303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:25.551219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:25.551219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:25.551219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:25.551219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:25.553069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 416/829] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:25.558451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0277135c-ccdc-4017-a841-734e0fc0bd5c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:25.559692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0277135c-ccdc-4017-a841-734e0fc0bd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:25.560201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2853c3-fef8-4860-b200-298db30006a5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:25.595906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:25.639008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 414/830] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:25.658629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277135c-ccdc-4017-a841-734e0fc0bd5c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:25.704905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2853c3-fef8-4860-b200-298db30006a5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:25.743664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:25.748530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d616-18ee-4c8e-9825-15be8550a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:25.749432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d616-18ee-4c8e-9825-15be8550a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:25.749979 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d616-18ee-4c8e-9825-15be8550a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:25.750513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d616-18ee-4c8e-9825-15be8550a8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:25.752093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65d616-18ee-4c8e-9825-15be8550a8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:25.757984 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65d616-18ee-4c8e-9825-15be8550a8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:25.759909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65d616-18ee-4c8e-9825-15be8550a8b9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:25.782033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 417/831] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:25.783446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d616-18ee-4c8e-9825-15be8550a8b9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:25.789568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277135c-ccdc-4017-a841-734e0fc0bd5c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:25.838923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15626bb1-43dd-4d73-80fa-3b69841ad094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:25.839603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15626bb1-43dd-4d73-80fa-3b69841ad094 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:25.839887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15626bb1-43dd-4d73-80fa-3b69841ad094 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:25.840295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15626bb1-43dd-4d73-80fa-3b69841ad094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:25.854775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15626bb1-43dd-4d73-80fa-3b69841ad094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-15626bb1-43dd-4d73-80fa-3b69841ad094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:25.861679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:25.862681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:25.863710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:25.867070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 415/832] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:25.869719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15626bb1-43dd-4d73-80fa-3b69841ad094 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:25.890148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:25.908313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d616-18ee-4c8e-9825-15be8550a8b9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:25.947793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ff2b1-a00d-4724-95f3-c57a3f46f2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:25.948522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ff2b1-a00d-4724-95f3-c57a3f46f2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:25.948749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ff2b1-a00d-4724-95f3-c57a3f46f2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:25.949021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ff2b1-a00d-4724-95f3-c57a3f46f2f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:25.956122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ff2b1-a00d-4724-95f3-c57a3f46f2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:25.957613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ff2b1-a00d-4724-95f3-c57a3f46f2f6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f21ff2b1-a00d-4724-95f3-c57a3f46f2f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:25.970022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:25.970935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:25.971842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:25.971842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:25.971842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:25.971842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:25.971842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:25.971842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:25.971842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:25.971842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:25.975386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 418/833] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:25.977154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ff2b1-a00d-4724-95f3-c57a3f46f2f6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:26.016784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15626bb1-43dd-4d73-80fa-3b69841ad094 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:26.056053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:26.072251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a615-0b68-4115-ae31-d2ab0da67256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:26.073162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a615-0b68-4115-ae31-d2ab0da67256 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.073874 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a615-0b68-4115-ae31-d2ab0da67256 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.074302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a615-0b68-4115-ae31-d2ab0da67256 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.075602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a615-0b68-4115-ae31-d2ab0da67256 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:26.076058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a615-0b68-4115-ae31-d2ab0da67256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:26.077567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a615-0b68-4115-ae31-d2ab0da67256 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:26.091650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ff2b1-a00d-4724-95f3-c57a3f46f2f6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:26.103116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 416/834] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:26.104301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a615-0b68-4115-ae31-d2ab0da67256 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:26.134669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd819763-102b-4aed-aa7b-79796b8b1372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:26.135481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd819763-102b-4aed-aa7b-79796b8b1372 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.135852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd819763-102b-4aed-aa7b-79796b8b1372 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.136251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd819763-102b-4aed-aa7b-79796b8b1372 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.137125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd819763-102b-4aed-aa7b-79796b8b1372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:26.137511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd819763-102b-4aed-aa7b-79796b8b1372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:26.139087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd819763-102b-4aed-aa7b-79796b8b1372 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:26.157624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 419/835] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:26.158631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd819763-102b-4aed-aa7b-79796b8b1372 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:26.163311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:26.226274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a615-0b68-4115-ae31-d2ab0da67256 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:26.263720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c9ed4-1ccb-4f88-8e20-c473b6cde0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:26.264516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c9ed4-1ccb-4f88-8e20-c473b6cde0fa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.264869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c9ed4-1ccb-4f88-8e20-c473b6cde0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.265205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c9ed4-1ccb-4f88-8e20-c473b6cde0fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.278821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c9ed4-1ccb-4f88-8e20-c473b6cde0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:26.280388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c9ed4-1ccb-4f88-8e20-c473b6cde0fa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:26.287843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd819763-102b-4aed-aa7b-79796b8b1372 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fc5c9ed4-1ccb-4f88-8e20-c473b6cde0fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:26.296609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:26.298379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:26.299270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:26.299270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:26.299270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:26.299270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:26.299270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 417/836] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:26.300121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa9e15-906c-4198-815f-0f4768cb02f7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.300479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa9e15-906c-4198-815f-0f4768cb02f7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.300647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa9e15-906c-4198-815f-0f4768cb02f7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.302020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 418/837] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:26.306046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa9e15-906c-4198-815f-0f4768cb02f7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:26.333501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85469-1b51-4bd3-9665-f4db075d1bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:26.334044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85469-1b51-4bd3-9665-f4db075d1bad None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.334323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85469-1b51-4bd3-9665-f4db075d1bad None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.334596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85469-1b51-4bd3-9665-f4db075d1bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.335415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85469-1b51-4bd3-9665-f4db075d1bad None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=642faef2d1654874bd7205420512998a, user.id=bd26e2ac2578438e854d51d8eed26463) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:26.335719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85469-1b51-4bd3-9665-f4db075d1bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:26.337148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85469-1b51-4bd3-9665-f4db075d1bad None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:26.344772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 420/838] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:26 2022] GET /identity/v3/role_assignments?user.id=bd26e2ac2578438e854d51d8eed26463&scope.project.id=642faef2d1654874bd7205420512998a&role.id=c1429555635349208e8b2bd908436746 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:26.346033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf31fe-d310-45b3-b8a0-4c188451ad23 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.346322 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf31fe-d310-45b3-b8a0-4c188451ad23 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.346597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf31fe-d310-45b3-b8a0-4c188451ad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.365865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:26.377888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0bdf31fe-d310-45b3-b8a0-4c188451ad23 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:26.379411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0bdf31fe-d310-45b3-b8a0-4c188451ad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:26.443564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa9e15-906c-4198-815f-0f4768cb02f7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:26.464142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:26.474558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 421/839] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:26.489991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94c247-0f60-4324-bac5-d0ce5360bc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:26.490912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c247-0f60-4324-bac5-d0ce5360bc4b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.491359 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c247-0f60-4324-bac5-d0ce5360bc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.491777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c247-0f60-4324-bac5-d0ce5360bc4b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.492696 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94c247-0f60-4324-bac5-d0ce5360bc4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:26.493148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94c247-0f60-4324-bac5-d0ce5360bc4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:26.494713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94c247-0f60-4324-bac5-d0ce5360bc4b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:26.498205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf31fe-d310-45b3-b8a0-4c188451ad23 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:26.517104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 419/840] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:26.519638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94c247-0f60-4324-bac5-d0ce5360bc4b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:26.638745 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf31fe-d310-45b3-b8a0-4c188451ad23 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:26.644215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:26.648377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94c247-0f60-4324-bac5-d0ce5360bc4b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:26.688038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9665c-6ca5-484d-b340-04e1221fb8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:26.688616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e88c1-5664-42ab-aadc-333bfcf83b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:26.689111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9665c-6ca5-484d-b340-04e1221fb8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.689304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e88c1-5664-42ab-aadc-333bfcf83b29 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.689588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e88c1-5664-42ab-aadc-333bfcf83b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.689862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e88c1-5664-42ab-aadc-333bfcf83b29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.689982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9665c-6ca5-484d-b340-04e1221fb8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.690385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9665c-6ca5-484d-b340-04e1221fb8f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.697541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e88c1-5664-42ab-aadc-333bfcf83b29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:26.699292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e88c1-5664-42ab-aadc-333bfcf83b29 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:26.703777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9665c-6ca5-484d-b340-04e1221fb8f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d9f9665c-6ca5-484d-b340-04e1221fb8f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:26.709039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:26.710538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:26.711392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 422/841] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:28:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7b9e88c1-5664-42ab-aadc-333bfcf83b29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:26.714432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:26.715911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 04:28:26.718200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:26.720093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9665c-6ca5-484d-b340-04e1221fb8f8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:26.723322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 420/842] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:26.726719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f347e-25dd-4b62-ad23-30e274a7e52a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.727349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f347e-25dd-4b62-ad23-30e274a7e52a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.727813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f347e-25dd-4b62-ad23-30e274a7e52a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.729330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 421/843] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:26.730199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f347e-25dd-4b62-ad23-30e274a7e52a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:26.793377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:26.839349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9665c-6ca5-484d-b340-04e1221fb8f8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:26.843065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f347e-25dd-4b62-ad23-30e274a7e52a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:26.879651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea98be4-9173-4fb3-b53d-613c29ce4710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:26.880013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c792267-5871-4bd2-a5be-18009f5354ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:26.880271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea98be4-9173-4fb3-b53d-613c29ce4710 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.880551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea98be4-9173-4fb3-b53d-613c29ce4710 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.880646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c792267-5871-4bd2-a5be-18009f5354ec None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.880821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea98be4-9173-4fb3-b53d-613c29ce4710 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.880916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c792267-5871-4bd2-a5be-18009f5354ec None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.881103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c792267-5871-4bd2-a5be-18009f5354ec None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.881545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea98be4-9173-4fb3-b53d-613c29ce4710 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:26.881872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea98be4-9173-4fb3-b53d-613c29ce4710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:26.881972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c792267-5871-4bd2-a5be-18009f5354ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:26.882174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c792267-5871-4bd2-a5be-18009f5354ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:26.883348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea98be4-9173-4fb3-b53d-613c29ce4710 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:26.883612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c792267-5871-4bd2-a5be-18009f5354ec None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:26.899102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 423/844] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:26.899102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef88f6-2c5e-452b-b9f3-c81c4cf68742 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:26.899102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef88f6-2c5e-452b-b9f3-c81c4cf68742 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:26.899102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef88f6-2c5e-452b-b9f3-c81c4cf68742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:26.907284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 422/845] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Aug 4 04:28:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:26.908524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c792267-5871-4bd2-a5be-18009f5354ec None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:26.920770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-28ef88f6-2c5e-452b-b9f3-c81c4cf68742 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:26.923674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-28ef88f6-2c5e-452b-b9f3-c81c4cf68742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:26.928204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:26.998840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 424/846] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:27.000260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef88f6-2c5e-452b-b9f3-c81c4cf68742 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.026468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c792267-5871-4bd2-a5be-18009f5354ec None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.061921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:27.066071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1337de-08bb-4c7d-a13e-53fe69e074cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.066716 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1337de-08bb-4c7d-a13e-53fe69e074cf None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.067026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1337de-08bb-4c7d-a13e-53fe69e074cf None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.067302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1337de-08bb-4c7d-a13e-53fe69e074cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.078300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1337de-08bb-4c7d-a13e-53fe69e074cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.079764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1337de-08bb-4c7d-a13e-53fe69e074cf None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-aa1337de-08bb-4c7d-a13e-53fe69e074cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:27.095897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:27.096786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:27.097648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:27.097648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:27.097648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:27.097648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:27.097648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 423/847] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:27.097920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1337de-08bb-4c7d-a13e-53fe69e074cf None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.120286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef88f6-2c5e-452b-b9f3-c81c4cf68742 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.157959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e6ef-e50b-454b-9f82-d1c5188b21a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.158633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e6ef-e50b-454b-9f82-d1c5188b21a6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.159016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e6ef-e50b-454b-9f82-d1c5188b21a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.159361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e6ef-e50b-454b-9f82-d1c5188b21a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.168847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:27.205118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1337de-08bb-4c7d-a13e-53fe69e074cf None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.239541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42888f-175f-4f0a-836a-8365072e259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.240236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42888f-175f-4f0a-836a-8365072e259e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.240515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42888f-175f-4f0a-836a-8365072e259e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.240787 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42888f-175f-4f0a-836a-8365072e259e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.241343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156e6ef-e50b-454b-9f82-d1c5188b21a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.241451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42888f-175f-4f0a-836a-8365072e259e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.242773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156e6ef-e50b-454b-9f82-d1c5188b21a6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.242873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42888f-175f-4f0a-836a-8365072e259e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fe42888f-175f-4f0a-836a-8365072e259e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:27.252667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:27.253639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:27.254481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 424/848] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:27.255316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42888f-175f-4f0a-836a-8365072e259e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.308493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:27.359967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42888f-175f-4f0a-836a-8365072e259e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.367913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 425/849] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:27.367913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e6ef-e50b-454b-9f82-d1c5188b21a6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.389664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:27.397236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0307cb-95c1-4e79-b3bf-bce4fe281068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.397860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0307cb-95c1-4e79-b3bf-bce4fe281068 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.398142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0307cb-95c1-4e79-b3bf-bce4fe281068 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.398414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0307cb-95c1-4e79-b3bf-bce4fe281068 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.399147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0307cb-95c1-4e79-b3bf-bce4fe281068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:27.399457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0307cb-95c1-4e79-b3bf-bce4fe281068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.400802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0307cb-95c1-4e79-b3bf-bce4fe281068 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.413015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 425/850] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:27.413574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0307cb-95c1-4e79-b3bf-bce4fe281068 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.477873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e6ef-e50b-454b-9f82-d1c5188b21a6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.521346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc92977-f996-4296-b696-37d26fa7b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.521967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc92977-f996-4296-b696-37d26fa7b1db None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.522249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc92977-f996-4296-b696-37d26fa7b1db None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.522524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc92977-f996-4296-b696-37d26fa7b1db None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.523226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc92977-f996-4296-b696-37d26fa7b1db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:27.523532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc92977-f996-4296-b696-37d26fa7b1db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.524889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc92977-f996-4296-b696-37d26fa7b1db None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.525785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0307cb-95c1-4e79-b3bf-bce4fe281068 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.529552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 426/851] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:27.530497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc92977-f996-4296-b696-37d26fa7b1db None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.553112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:27.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635399-0f60-47b4-ba74-a1795bdd3c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.569422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635399-0f60-47b4-ba74-a1795bdd3c98 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.569700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635399-0f60-47b4-ba74-a1795bdd3c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.569974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635399-0f60-47b4-ba74-a1795bdd3c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.580318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635399-0f60-47b4-ba74-a1795bdd3c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.581754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635399-0f60-47b4-ba74-a1795bdd3c98 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f0635399-0f60-47b4-ba74-a1795bdd3c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:27.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:27.598229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:27.599132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:27.599132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:27.599132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:27.599132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:27.599132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 426/852] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:27.599132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635399-0f60-47b4-ba74-a1795bdd3c98 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.651195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:27.654161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc92977-f996-4296-b696-37d26fa7b1db None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.690282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea03af-2550-40d9-9e4c-3b063494e115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.690943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea03af-2550-40d9-9e4c-3b063494e115 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.691211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea03af-2550-40d9-9e4c-3b063494e115 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.691530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea03af-2550-40d9-9e4c-3b063494e115 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.699182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea03af-2550-40d9-9e4c-3b063494e115 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.700458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea03af-2550-40d9-9e4c-3b063494e115 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.712622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635399-0f60-47b4-ba74-a1795bdd3c98 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3dea03af-2550-40d9-9e4c-3b063494e115 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:27.713689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:27.715653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 427/853] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:27.716595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea03af-2550-40d9-9e4c-3b063494e115 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.754564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece449c5-4e71-4fc1-93c7-e6ca3b54bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.755209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece449c5-4e71-4fc1-93c7-e6ca3b54bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.755490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece449c5-4e71-4fc1-93c7-e6ca3b54bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.755761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece449c5-4e71-4fc1-93c7-e6ca3b54bcf3 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.756461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece449c5-4e71-4fc1-93c7-e6ca3b54bcf3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:27.756742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece449c5-4e71-4fc1-93c7-e6ca3b54bcf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.758610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece449c5-4e71-4fc1-93c7-e6ca3b54bcf3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.762942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 427/854] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:27.763779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece449c5-4e71-4fc1-93c7-e6ca3b54bcf3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.838284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:27.879014 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea03af-2550-40d9-9e4c-3b063494e115 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.905271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece449c5-4e71-4fc1-93c7-e6ca3b54bcf3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:27.921664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6442548-ef4c-4393-a245-baf2927047e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.922690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442548-ef4c-4393-a245-baf2927047e0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.923035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:27.923259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442548-ef4c-4393-a245-baf2927047e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.923654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6442548-ef4c-4393-a245-baf2927047e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.924417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6442548-ef4c-4393-a245-baf2927047e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:27.924789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6442548-ef4c-4393-a245-baf2927047e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.926236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6442548-ef4c-4393-a245-baf2927047e0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.941340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 428/855] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:27.946851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6442548-ef4c-4393-a245-baf2927047e0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:27.959734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce78a1d-2b74-43ff-8175-6444e5aa9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:27.960722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78a1d-2b74-43ff-8175-6444e5aa9600 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:27.961123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78a1d-2b74-43ff-8175-6444e5aa9600 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:27.961577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce78a1d-2b74-43ff-8175-6444e5aa9600 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:27.962377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce78a1d-2b74-43ff-8175-6444e5aa9600 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:27.962676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce78a1d-2b74-43ff-8175-6444e5aa9600 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:27.971072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce78a1d-2b74-43ff-8175-6444e5aa9600 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:27.984935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 428/856] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:27.990332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce78a1d-2b74-43ff-8175-6444e5aa9600 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:28.071774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6442548-ef4c-4393-a245-baf2927047e0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:28.119143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09dbf5-790d-4c1c-bdfc-81f4b6857334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:28.120006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09dbf5-790d-4c1c-bdfc-81f4b6857334 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.120374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09dbf5-790d-4c1c-bdfc-81f4b6857334 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.120737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09dbf5-790d-4c1c-bdfc-81f4b6857334 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.122253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce78a1d-2b74-43ff-8175-6444e5aa9600 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:28.122864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:28.129622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09dbf5-790d-4c1c-bdfc-81f4b6857334 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:28.132179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09dbf5-790d-4c1c-bdfc-81f4b6857334 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3d09dbf5-790d-4c1c-bdfc-81f4b6857334 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:28.144793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:28.145906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:28.147013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:28.147013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:28.147013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:28.147013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:28.147013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:28.147013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:28.147013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:28.147013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:28.151019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 429/857] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:28.153974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09dbf5-790d-4c1c-bdfc-81f4b6857334 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:28.168763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c36f-f49e-4084-b12e-17b5d545d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:28.169410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2c36f-f49e-4084-b12e-17b5d545d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.169851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2c36f-f49e-4084-b12e-17b5d545d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.170163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2c36f-f49e-4084-b12e-17b5d545d6a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.215906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:28.256729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2c36f-f49e-4084-b12e-17b5d545d6a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:28.258183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2c36f-f49e-4084-b12e-17b5d545d6a8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:28.278719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09dbf5-790d-4c1c-bdfc-81f4b6857334 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:28.315722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51555a23-ecb8-4766-9cde-8fbf3c63ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:28.316678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555a23-ecb8-4766-9cde-8fbf3c63ccfd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.317171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555a23-ecb8-4766-9cde-8fbf3c63ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.317646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555a23-ecb8-4766-9cde-8fbf3c63ccfd None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.318653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555a23-ecb8-4766-9cde-8fbf3c63ccfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:28.319232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555a23-ecb8-4766-9cde-8fbf3c63ccfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:28.320819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555a23-ecb8-4766-9cde-8fbf3c63ccfd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:28.334229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 430/858] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:28.343131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51555a23-ecb8-4766-9cde-8fbf3c63ccfd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:28.369753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 429/859] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 04:28:28.370905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c36f-f49e-4084-b12e-17b5d545d6a8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:28.408888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:28.440575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:28.457577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51555a23-ecb8-4766-9cde-8fbf3c63ccfd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:28.477590 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c36f-f49e-4084-b12e-17b5d545d6a8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:28.500492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3edc8-d1f4-4158-805d-094475e222dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:28.501146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3edc8-d1f4-4158-805d-094475e222dd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.501339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3edc8-d1f4-4158-805d-094475e222dd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.501610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3edc8-d1f4-4158-805d-094475e222dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.502397 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3edc8-d1f4-4158-805d-094475e222dd None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=642faef2d1654874bd7205420512998a, user.id=5dcb9d2fbde74819b3848d050299cfe9) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:28.502698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3edc8-d1f4-4158-805d-094475e222dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:28.504282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3edc8-d1f4-4158-805d-094475e222dd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:28.517794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 431/860] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:28 2022] GET /identity/v3/role_assignments?user.id=5dcb9d2fbde74819b3848d050299cfe9&scope.project.id=642faef2d1654874bd7205420512998a&role.id=c1429555635349208e8b2bd908436746 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:28.517794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb757-b063-47fd-957a-b8c9c204f585 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.517794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb757-b063-47fd-957a-b8c9c204f585 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.517794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb757-b063-47fd-957a-b8c9c204f585 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.517794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 432/861] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:28.519587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb911e7-3245-43cf-855a-49dc261e070e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.519808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb911e7-3245-43cf-855a-49dc261e070e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.520083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb911e7-3245-43cf-855a-49dc261e070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.522338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9080ec1-11c4-4271-83b3-37e902a8579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:28.523198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9080ec1-11c4-4271-83b3-37e902a8579f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.523580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9080ec1-11c4-4271-83b3-37e902a8579f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.523948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9080ec1-11c4-4271-83b3-37e902a8579f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.536906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9080ec1-11c4-4271-83b3-37e902a8579f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:28.538495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9080ec1-11c4-4271-83b3-37e902a8579f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:28.541342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2cb911e7-3245-43cf-855a-49dc261e070e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:28.542742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2cb911e7-3245-43cf-855a-49dc261e070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c9080ec1-11c4-4271-83b3-37e902a8579f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:28.556732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:28.557875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:28.559015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:28.559015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:28.559015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:28.559015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:28.559962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 430/862] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:28.565574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9080ec1-11c4-4271-83b3-37e902a8579f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:28.636258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 433/863] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:28.660213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb911e7-3245-43cf-855a-49dc261e070e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:28.701441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9080ec1-11c4-4271-83b3-37e902a8579f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:28.718965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:28.726251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:28.756173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cf10a-8a02-408a-ab29-5242864c9790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:28.756173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cf10a-8a02-408a-ab29-5242864c9790 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.756173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cf10a-8a02-408a-ab29-5242864c9790 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.756528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cf10a-8a02-408a-ab29-5242864c9790 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.757056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cf10a-8a02-408a-ab29-5242864c9790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:28.757360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cf10a-8a02-408a-ab29-5242864c9790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:28.759138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cf10a-8a02-408a-ab29-5242864c9790 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:28.774125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 431/864] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:28.779496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cf10a-8a02-408a-ab29-5242864c9790 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:28.800626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb911e7-3245-43cf-855a-49dc261e070e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:28.838900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9977ce-6285-47df-b5d7-f10942562bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:28.839585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9977ce-6285-47df-b5d7-f10942562bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.839860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9977ce-6285-47df-b5d7-f10942562bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.840129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9977ce-6285-47df-b5d7-f10942562bf8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.840847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9977ce-6285-47df-b5d7-f10942562bf8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:28.842299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9977ce-6285-47df-b5d7-f10942562bf8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3c9977ce-6285-47df-b5d7-f10942562bf8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:28.852363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:28.853300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:28.854113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 434/865] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Aug 4 04:28:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:28.860619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9977ce-6285-47df-b5d7-f10942562bf8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:28.914748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cf10a-8a02-408a-ab29-5242864c9790 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:28.956311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc19b7-4dc9-4e86-a2d7-e563556522f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:28.956964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc19b7-4dc9-4e86-a2d7-e563556522f2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:28.957247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc19b7-4dc9-4e86-a2d7-e563556522f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:28.957531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc19b7-4dc9-4e86-a2d7-e563556522f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:28.965328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc19b7-4dc9-4e86-a2d7-e563556522f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:28.966834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc19b7-4dc9-4e86-a2d7-e563556522f2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c2cc19b7-4dc9-4e86-a2d7-e563556522f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:28.979773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:28.980713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:28.981575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:28.981575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:28.981575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:28.981575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:28.981575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:28.981575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:28.981575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:28.981575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:28.981575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 432/866] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:28.989906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc19b7-4dc9-4e86-a2d7-e563556522f2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:28.990092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9977ce-6285-47df-b5d7-f10942562bf8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:29.002854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:29.026872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c987-69bc-4eaa-8b51-0100835d5eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:29.027574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c987-69bc-4eaa-8b51-0100835d5eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:29.027952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c987-69bc-4eaa-8b51-0100835d5eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:29.028374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c987-69bc-4eaa-8b51-0100835d5eb5 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:29.029150 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4c987-69bc-4eaa-8b51-0100835d5eb5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:29.029572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4c987-69bc-4eaa-8b51-0100835d5eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:29.031646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4c987-69bc-4eaa-8b51-0100835d5eb5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:29.041459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 435/867] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:29.042470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c987-69bc-4eaa-8b51-0100835d5eb5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:29.048468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:29.119371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc19b7-4dc9-4e86-a2d7-e563556522f2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:29.155698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855259-e09a-44d1-941f-2c15ac293c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:29.157038 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855259-e09a-44d1-941f-2c15ac293c59 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:29.157354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855259-e09a-44d1-941f-2c15ac293c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:29.157636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855259-e09a-44d1-941f-2c15ac293c59 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:29.158685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4855259-e09a-44d1-941f-2c15ac293c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:29.158905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4855259-e09a-44d1-941f-2c15ac293c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:29.160499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4855259-e09a-44d1-941f-2c15ac293c59 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:29.177474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c987-69bc-4eaa-8b51-0100835d5eb5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:29.179758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 433/868] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:29.182812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855259-e09a-44d1-941f-2c15ac293c59 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:29.226483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f032202-a35a-44de-b76b-31070059cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:29.227543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032202-a35a-44de-b76b-31070059cc2c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:29.228101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032202-a35a-44de-b76b-31070059cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:29.228578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032202-a35a-44de-b76b-31070059cc2c None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:29.229510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f032202-a35a-44de-b76b-31070059cc2c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:29.230013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f032202-a35a-44de-b76b-31070059cc2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:29.232194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f032202-a35a-44de-b76b-31070059cc2c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:29.247017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 436/869] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:29.310032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:29.315474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855259-e09a-44d1-941f-2c15ac293c59 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:29.357131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934624b7-d48a-49f2-be00-97c64df6d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:29.357767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934624b7-d48a-49f2-be00-97c64df6d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:29.358048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934624b7-d48a-49f2-be00-97c64df6d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:29.358323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934624b7-d48a-49f2-be00-97c64df6d2b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:29.359228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934624b7-d48a-49f2-be00-97c64df6d2b9 None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=fb129070880846549efcb9925c2736c7) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:29.359537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934624b7-d48a-49f2-be00-97c64df6d2b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:29.361111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934624b7-d48a-49f2-be00-97c64df6d2b9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:29.368866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 434/870] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:29 2022] GET /identity/v3/role_assignments?user.id=fb129070880846549efcb9925c2736c7&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:29.890487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66fd46-d10b-4eb4-b88e-8e22a06ec526 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:29.891568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66fd46-d10b-4eb4-b88e-8e22a06ec526 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:29.892054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66fd46-d10b-4eb4-b88e-8e22a06ec526 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:29.893855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 437/871] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:29.899238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae08c6e-c877-4f7e-a595-da6a68b92c71 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:29.899749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae08c6e-c877-4f7e-a595-da6a68b92c71 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:29.900222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae08c6e-c877-4f7e-a595-da6a68b92c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:29.920340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bae08c6e-c877-4f7e-a595-da6a68b92c71 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:29.923222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bae08c6e-c877-4f7e-a595-da6a68b92c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:29.996013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 435/872] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:30.017953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66fd46-d10b-4eb4-b88e-8e22a06ec526 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:30.067030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:30.137020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66fd46-d10b-4eb4-b88e-8e22a06ec526 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:30.177026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d646f34-c0b9-49f1-9cb4-2b883ee32c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:30.177726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d646f34-c0b9-49f1-9cb4-2b883ee32c90 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:30.178053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d646f34-c0b9-49f1-9cb4-2b883ee32c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:30.178354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d646f34-c0b9-49f1-9cb4-2b883ee32c90 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:30.179192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d646f34-c0b9-49f1-9cb4-2b883ee32c90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:30.180902 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d646f34-c0b9-49f1-9cb4-2b883ee32c90 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:30.197818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 438/873] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:28:30 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:30.649112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20385381-473a-408c-ae3a-91f207ee87cc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:30.649500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20385381-473a-408c-ae3a-91f207ee87cc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:30.649677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20385381-473a-408c-ae3a-91f207ee87cc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:30.651324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 436/874] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:30.657276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6d69-6320-448a-99e7-2a0b787ab1c6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:30.657658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6d69-6320-448a-99e7-2a0b787ab1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:30.657960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d6d69-6320-448a-99e7-2a0b787ab1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:30.678479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-aa2d6d69-6320-448a-99e7-2a0b787ab1c6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:30.679858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aa2d6d69-6320-448a-99e7-2a0b787ab1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:30.758695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 439/875] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:30.782210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20385381-473a-408c-ae3a-91f207ee87cc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:30.878633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:30.888450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20385381-473a-408c-ae3a-91f207ee87cc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:30.924964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889b15b-8e94-497f-a3af-936f9845d018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:30.925589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889b15b-8e94-497f-a3af-936f9845d018 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:30.925801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889b15b-8e94-497f-a3af-936f9845d018 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:30.926048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889b15b-8e94-497f-a3af-936f9845d018 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:30.926675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889b15b-8e94-497f-a3af-936f9845d018 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:30.928073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889b15b-8e94-497f-a3af-936f9845d018 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d889b15b-8e94-497f-a3af-936f9845d018 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:30.937451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:30.938437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:30.939956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 437/876] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:30.945016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d6d69-6320-448a-99e7-2a0b787ab1c6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:30.980809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:31.058424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d6d69-6320-448a-99e7-2a0b787ab1c6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:31.094132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f56be-5026-47eb-b418-fbde12b11f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:31.094750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f56be-5026-47eb-b418-fbde12b11f18 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:31.095052 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f56be-5026-47eb-b418-fbde12b11f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:31.095325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f56be-5026-47eb-b418-fbde12b11f18 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:31.096004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f56be-5026-47eb-b418-fbde12b11f18 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:31.096297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f56be-5026-47eb-b418-fbde12b11f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:31.097717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f56be-5026-47eb-b418-fbde12b11f18 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:31.102867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 440/877] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:31.112155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889b15b-8e94-497f-a3af-936f9845d018 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:31.214906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889b15b-8e94-497f-a3af-936f9845d018 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:31.252288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f8477-4d17-4275-abe1-f49e9738e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:31.252961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f8477-4d17-4275-abe1-f49e9738e966 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:31.253278 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f8477-4d17-4275-abe1-f49e9738e966 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:31.253556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f8477-4d17-4275-abe1-f49e9738e966 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:31.254239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f8477-4d17-4275-abe1-f49e9738e966 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:31.254542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f8477-4d17-4275-abe1-f49e9738e966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:31.256390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f8477-4d17-4275-abe1-f49e9738e966 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:31.262803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 438/878] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:31.432141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7d6f2-0754-42b0-97a4-89e50375d648 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:31.432468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7d6f2-0754-42b0-97a4-89e50375d648 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:31.432669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7d6f2-0754-42b0-97a4-89e50375d648 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:31.434390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 441/879] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:31.441024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a9f9-99dd-4953-b409-efd01cc494f5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:31.441332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a9f9-99dd-4953-b409-efd01cc494f5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:31.441634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a9f9-99dd-4953-b409-efd01cc494f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:31.462003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2df3a9f9-99dd-4953-b409-efd01cc494f5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:31.467086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2df3a9f9-99dd-4953-b409-efd01cc494f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:31.478517 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:31.539193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 439/880] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:31.556021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7d6f2-0754-42b0-97a4-89e50375d648 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:31.655018 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585f9da-e549-4260-b30b-f8d43980c189 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:31.655351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585f9da-e549-4260-b30b-f8d43980c189 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:31.655584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585f9da-e549-4260-b30b-f8d43980c189 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:31.657296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 440/881] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:31.662180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73cca7-3605-4daa-859c-ecd1c367ceab None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:31.662524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73cca7-3605-4daa-859c-ecd1c367ceab None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:31.662738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73cca7-3605-4daa-859c-ecd1c367ceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:31.665702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:31.670550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7d6f2-0754-42b0-97a4-89e50375d648 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:31.684481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ad73cca7-3605-4daa-859c-ecd1c367ceab None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:31.686182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad73cca7-3605-4daa-859c-ecd1c367ceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:31.711445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88bbfe-ff1e-47b6-9534-2d563b819f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:31.712299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88bbfe-ff1e-47b6-9534-2d563b819f4e None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:31.712639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88bbfe-ff1e-47b6-9534-2d563b819f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:31.713032 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88bbfe-ff1e-47b6-9534-2d563b819f4e None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:31.713892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88bbfe-ff1e-47b6-9534-2d563b819f4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:31.715404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88bbfe-ff1e-47b6-9534-2d563b819f4e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:31.735522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 442/882] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:28:31 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:31.786025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 441/883] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:31.810331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88bbfe-ff1e-47b6-9534-2d563b819f4e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:31.926867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88bbfe-ff1e-47b6-9534-2d563b819f4e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:31.963540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e02c5-3882-4558-b37a-01b50c7612c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:31.964302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e02c5-3882-4558-b37a-01b50c7612c0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:31.964471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e02c5-3882-4558-b37a-01b50c7612c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:31.964741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e02c5-3882-4558-b37a-01b50c7612c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:31.976235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e02c5-3882-4558-b37a-01b50c7612c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3e5e02c5-3882-4558-b37a-01b50c7612c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:31.981661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:31.982599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:31.983451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 443/884] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Aug 4 04:28:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:31.991395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73cca7-3605-4daa-859c-ecd1c367ceab None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:32.072959 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:32.099473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73cca7-3605-4daa-859c-ecd1c367ceab None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:32.135428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c8668-e115-44c3-b50b-bfbdcdc537e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:32.136380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c8668-e115-44c3-b50b-bfbdcdc537e1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.136887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c8668-e115-44c3-b50b-bfbdcdc537e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.137398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c8668-e115-44c3-b50b-bfbdcdc537e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.138358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c8668-e115-44c3-b50b-bfbdcdc537e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:32.138858 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c8668-e115-44c3-b50b-bfbdcdc537e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:32.141041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c8668-e115-44c3-b50b-bfbdcdc537e1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:32.153010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 442/885] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Aug 4 04:28:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:32.158890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e02c5-3882-4558-b37a-01b50c7612c0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:32.173758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:32.264452 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e02c5-3882-4558-b37a-01b50c7612c0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:32.304198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64eb8a-ec77-4d72-b143-182ccd5a4105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:32.304899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64eb8a-ec77-4d72-b143-182ccd5a4105 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.305184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64eb8a-ec77-4d72-b143-182ccd5a4105 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.305457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64eb8a-ec77-4d72-b143-182ccd5a4105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.316476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64eb8a-ec77-4d72-b143-182ccd5a4105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:32.318013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64eb8a-ec77-4d72-b143-182ccd5a4105 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3b64eb8a-ec77-4d72-b143-182ccd5a4105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:32.332763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:32.333640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:32.334923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:32.334923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:32.334923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:32.334923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:32.334923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 444/886] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:32.339973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c8668-e115-44c3-b50b-bfbdcdc537e1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:32.361264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2896f58-02cc-47f0-8863-812202c5c41d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.361562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2896f58-02cc-47f0-8863-812202c5c41d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.361808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2896f58-02cc-47f0-8863-812202c5c41d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.363438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 445/887] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:32.369351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc5f7-96fb-4267-ae7f-ac55673da257 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.370013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc5f7-96fb-4267-ae7f-ac55673da257 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.370843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc5f7-96fb-4267-ae7f-ac55673da257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.392804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-58ebc5f7-96fb-4267-ae7f-ac55673da257 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:32.393989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-58ebc5f7-96fb-4267-ae7f-ac55673da257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:32.468046 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:32.473019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c8668-e115-44c3-b50b-bfbdcdc537e1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:32.483672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 446/888] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:32.505798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebc5f7-96fb-4267-ae7f-ac55673da257 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:32.516247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a779393-52e2-49ca-8b10-5a69c00ecd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:32.517155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a779393-52e2-49ca-8b10-5a69c00ecd3b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.517444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a779393-52e2-49ca-8b10-5a69c00ecd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.517720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a779393-52e2-49ca-8b10-5a69c00ecd3b None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.519010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a779393-52e2-49ca-8b10-5a69c00ecd3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:32.519329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a779393-52e2-49ca-8b10-5a69c00ecd3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:32.520881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a779393-52e2-49ca-8b10-5a69c00ecd3b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:32.538322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 443/889] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:32.538912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:32.544069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a779393-52e2-49ca-8b10-5a69c00ecd3b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:32.617703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebc5f7-96fb-4267-ae7f-ac55673da257 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:32.650272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a779393-52e2-49ca-8b10-5a69c00ecd3b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:32.654163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdcad3-0707-4cbf-b465-096e39f3801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:32.654835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdcad3-0707-4cbf-b465-096e39f3801e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.655151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdcad3-0707-4cbf-b465-096e39f3801e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.655425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdcad3-0707-4cbf-b465-096e39f3801e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.656114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdcad3-0707-4cbf-b465-096e39f3801e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:32.657467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdcad3-0707-4cbf-b465-096e39f3801e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-38cdcad3-0707-4cbf-b465-096e39f3801e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:32.666923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:32.667890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:28:32.668735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:32.674073 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 447/890] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:28:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:32.675088 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdcad3-0707-4cbf-b465-096e39f3801e None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:32.686810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c2628-da32-4795-9b4d-d983716de81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:32.688092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c2628-da32-4795-9b4d-d983716de81e None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.688373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c2628-da32-4795-9b4d-d983716de81e None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.688648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c2628-da32-4795-9b4d-d983716de81e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.696096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c2628-da32-4795-9b4d-d983716de81e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:32.697525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c2628-da32-4795-9b4d-d983716de81e None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ba0c2628-da32-4795-9b4d-d983716de81e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:32.709310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:32.711427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:32.713690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:32.719030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 444/891] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:28:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:32.720289 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c2628-da32-4795-9b4d-d983716de81e None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:32.735178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:32.783328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdcad3-0707-4cbf-b465-096e39f3801e None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:32.790044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:32.823359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9c3d-5d5f-48d7-8dc9-dd678153405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:32.824277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9c3d-5d5f-48d7-8dc9-dd678153405a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.824734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9c3d-5d5f-48d7-8dc9-dd678153405a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.825155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9c3d-5d5f-48d7-8dc9-dd678153405a None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.826038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a9c3d-5d5f-48d7-8dc9-dd678153405a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:32.826580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a9c3d-5d5f-48d7-8dc9-dd678153405a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:32.828280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a9c3d-5d5f-48d7-8dc9-dd678153405a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:32.838107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c2628-da32-4795-9b4d-d983716de81e None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:32.838609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 448/892] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:28:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:32.839765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9c3d-5d5f-48d7-8dc9-dd678153405a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:32.874451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9f412-7a2b-46bc-b127-796f3ab6141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:32.875645 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9f412-7a2b-46bc-b127-796f3ab6141f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.876004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9f412-7a2b-46bc-b127-796f3ab6141f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.876277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9f412-7a2b-46bc-b127-796f3ab6141f None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.877145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9f412-7a2b-46bc-b127-796f3ab6141f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:32.877457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9f412-7a2b-46bc-b127-796f3ab6141f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:32.879717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9f412-7a2b-46bc-b127-796f3ab6141f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:32.902870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 445/893] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Aug 4 04:28:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:32.903819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9f412-7a2b-46bc-b127-796f3ab6141f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:32.952305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9c3d-5d5f-48d7-8dc9-dd678153405a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:32.974471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:32.989889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b6f2-8c4c-4a3b-a743-669d85085751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:32.990504 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b6f2-8c4c-4a3b-a743-669d85085751 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:32.990777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b6f2-8c4c-4a3b-a743-669d85085751 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:32.991084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455b6f2-8c4c-4a3b-a743-669d85085751 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:32.991863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b6f2-8c4c-4a3b-a743-669d85085751 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:32.992163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b6f2-8c4c-4a3b-a743-669d85085751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:32.993616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455b6f2-8c4c-4a3b-a743-669d85085751 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:33.000127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 449/894] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:28:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:33.005661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b6f2-8c4c-4a3b-a743-669d85085751 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:33.023007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9f412-7a2b-46bc-b127-796f3ab6141f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:33.035113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:33.055629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c9016-8964-4c90-8e99-ae3184bf7f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:33.056399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c9016-8964-4c90-8e99-ae3184bf7f47 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.056792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c9016-8964-4c90-8e99-ae3184bf7f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.057074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c9016-8964-4c90-8e99-ae3184bf7f47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.137339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c9016-8964-4c90-8e99-ae3184bf7f47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:33.139482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c9016-8964-4c90-8e99-ae3184bf7f47 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:33.144103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455b6f2-8c4c-4a3b-a743-669d85085751 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:33.188841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19364e12-26d3-47b3-93ca-afe9eb036a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:33.189865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19364e12-26d3-47b3-93ca-afe9eb036a13 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.190417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19364e12-26d3-47b3-93ca-afe9eb036a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.190698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19364e12-26d3-47b3-93ca-afe9eb036a13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.191549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19364e12-26d3-47b3-93ca-afe9eb036a13 None admin] RBAC: Adding query filter params (interface=public, service_id=3f8537e97a52489c8f41ee3fff242d07, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:33.192119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19364e12-26d3-47b3-93ca-afe9eb036a13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:33.194328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19364e12-26d3-47b3-93ca-afe9eb036a13 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:33.200387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 450/895] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Aug 4 04:28:33 2022] GET /identity/v3/endpoints?service_id=3f8537e97a52489c8f41ee3fff242d07&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:33.207212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19364e12-26d3-47b3-93ca-afe9eb036a13 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:33.259341 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:33.265903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 446/896] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:32 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:33.271738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c9016-8964-4c90-8e99-ae3184bf7f47 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:33.295269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:33.326594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19364e12-26d3-47b3-93ca-afe9eb036a13 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:33.369077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980070f-27a3-4e16-a9d0-a8bd32153c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:33.369708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980070f-27a3-4e16-a9d0-a8bd32153c60 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.369992 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980070f-27a3-4e16-a9d0-a8bd32153c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.370266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980070f-27a3-4e16-a9d0-a8bd32153c60 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.370922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980070f-27a3-4e16-a9d0-a8bd32153c60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:33.372323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980070f-27a3-4e16-a9d0-a8bd32153c60 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:33.387153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 451/897] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Aug 4 04:28:33 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:28:33.408291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c9016-8964-4c90-8e99-ae3184bf7f47 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:33.409337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd34ae-51bd-4015-8360-2015fddab12e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.409626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd34ae-51bd-4015-8360-2015fddab12e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.409905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd34ae-51bd-4015-8360-2015fddab12e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.415365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 452/898] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:33.417860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea09f4-4ddf-462e-931d-c6cbfd332a0a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.418206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea09f4-4ddf-462e-931d-c6cbfd332a0a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.419239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea09f4-4ddf-462e-931d-c6cbfd332a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.444371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4bea09f4-4ddf-462e-931d-c6cbfd332a0a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:33.445671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4bea09f4-4ddf-462e-931d-c6cbfd332a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:33.458288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817bcc7-91b9-49d4-bbfc-85a5e4744c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:33.459705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817bcc7-91b9-49d4-bbfc-85a5e4744c5d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.460191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817bcc7-91b9-49d4-bbfc-85a5e4744c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.461019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817bcc7-91b9-49d4-bbfc-85a5e4744c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.477050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817bcc7-91b9-49d4-bbfc-85a5e4744c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:33.479620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817bcc7-91b9-49d4-bbfc-85a5e4744c5d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-9817bcc7-91b9-49d4-bbfc-85a5e4744c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:33.500293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:33.501381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:33.502240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:33.502240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:33.502240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:33.502240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:33.504934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 447/899] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:33.511056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817bcc7-91b9-49d4-bbfc-85a5e4744c5d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:33.541492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 453/900] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:33.565696 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea09f4-4ddf-462e-931d-c6cbfd332a0a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:33.592105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:33.628297 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817bcc7-91b9-49d4-bbfc-85a5e4744c5d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:33.651370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:33.666127 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feb02e-2cf7-4fde-a28a-9f765209fc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:33.666897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feb02e-2cf7-4fde-a28a-9f765209fc76 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.667298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feb02e-2cf7-4fde-a28a-9f765209fc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.667824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74feb02e-2cf7-4fde-a28a-9f765209fc76 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.668954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feb02e-2cf7-4fde-a28a-9f765209fc76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:33.669367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feb02e-2cf7-4fde-a28a-9f765209fc76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:33.671161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74feb02e-2cf7-4fde-a28a-9f765209fc76 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:33.675940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea09f4-4ddf-462e-931d-c6cbfd332a0a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:33.685147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 448/901] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:33.691131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feb02e-2cf7-4fde-a28a-9f765209fc76 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:33.717614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9b9f6-8888-4562-88fc-2e5c625bc119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:33.719225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9b9f6-8888-4562-88fc-2e5c625bc119 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.719866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9b9f6-8888-4562-88fc-2e5c625bc119 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.720282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9b9f6-8888-4562-88fc-2e5c625bc119 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.721232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9b9f6-8888-4562-88fc-2e5c625bc119 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:33.722864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9b9f6-8888-4562-88fc-2e5c625bc119 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:33.751168 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 454/902] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:28:33 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:28:33.806174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74feb02e-2cf7-4fde-a28a-9f765209fc76 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:33.838335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:33.853469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbb300-f9e3-4a11-b148-f3f2f9d5f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:33.854167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbb300-f9e3-4a11-b148-f3f2f9d5f486 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.854459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbb300-f9e3-4a11-b148-f3f2f9d5f486 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.854732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbb300-f9e3-4a11-b148-f3f2f9d5f486 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.862682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbb300-f9e3-4a11-b148-f3f2f9d5f486 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:33.864333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbb300-f9e3-4a11-b148-f3f2f9d5f486 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4cbbb300-f9e3-4a11-b148-f3f2f9d5f486 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:33.877468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:33.878427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:33.879767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:33.879767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:33.879767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:33.879767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:33.879767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:33.879767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:33.879767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:33.879767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:33.883073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 449/903] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:33.884890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9b9f6-8888-4562-88fc-2e5c625bc119 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:33.890086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160edd9b-fc95-47cc-866c-7b5aa9b91318 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.890492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160edd9b-fc95-47cc-866c-7b5aa9b91318 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.890721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160edd9b-fc95-47cc-866c-7b5aa9b91318 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.892425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 450/904] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:33.897817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50bc53-4d69-4c59-8894-1bf4f6d0ff21 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:33.898159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50bc53-4d69-4c59-8894-1bf4f6d0ff21 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:33.898441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50bc53-4d69-4c59-8894-1bf4f6d0ff21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:33.917347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fb50bc53-4d69-4c59-8894-1bf4f6d0ff21 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:33.918643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fb50bc53-4d69-4c59-8894-1bf4f6d0ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:34.012678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 451/905] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:34.013253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9b9f6-8888-4562-88fc-2e5c625bc119 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:34.023290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:34.040947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50bc53-4d69-4c59-8894-1bf4f6d0ff21 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:34.056259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c4e19-029d-4fbb-b8c1-ec0a1302e509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:34.057205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c4e19-029d-4fbb-b8c1-ec0a1302e509 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:34.057707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c4e19-029d-4fbb-b8c1-ec0a1302e509 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:34.058403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c4e19-029d-4fbb-b8c1-ec0a1302e509 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:34.059532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c4e19-029d-4fbb-b8c1-ec0a1302e509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:34.060057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c4e19-029d-4fbb-b8c1-ec0a1302e509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:34.061711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c4e19-029d-4fbb-b8c1-ec0a1302e509 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:34.076412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 455/906] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:34.083832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c4e19-029d-4fbb-b8c1-ec0a1302e509 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:34.180378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50bc53-4d69-4c59-8894-1bf4f6d0ff21 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:34.197281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c4e19-029d-4fbb-b8c1-ec0a1302e509 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:34.201960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:34.233394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cee39-5160-4465-8f99-23a4f90a44e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:34.234638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be777-1d94-4ad0-87ed-eb76d66a969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:34.234823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cee39-5160-4465-8f99-23a4f90a44e6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:34.235232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cee39-5160-4465-8f99-23a4f90a44e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:34.235601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cee39-5160-4465-8f99-23a4f90a44e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:34.235918 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be777-1d94-4ad0-87ed-eb76d66a969d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:34.236338 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be777-1d94-4ad0-87ed-eb76d66a969d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:34.236497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cee39-5160-4465-8f99-23a4f90a44e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:34.236901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be777-1d94-4ad0-87ed-eb76d66a969d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:34.237825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be777-1d94-4ad0-87ed-eb76d66a969d None admin] RBAC: Adding query filter params (role.id=b9beb0e1058b4fe0b7c885c46f775cab, scope.project.id=642faef2d1654874bd7205420512998a, user.id=fb129070880846549efcb9925c2736c7) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:34.238144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cee39-5160-4465-8f99-23a4f90a44e6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:34.238446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be777-1d94-4ad0-87ed-eb76d66a969d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:34.240235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be777-1d94-4ad0-87ed-eb76d66a969d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ee6cee39-5160-4465-8f99-23a4f90a44e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:34.255239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:34.256243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:34.257062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 452/908] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Aug 4 04:28:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:34.257898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cee39-5160-4465-8f99-23a4f90a44e6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:34.258566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 456/908] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:34 2022] GET /identity/v3/role_assignments?user.id=fb129070880846549efcb9925c2736c7&scope.project.id=642faef2d1654874bd7205420512998a&role.id=b9beb0e1058b4fe0b7c885c46f775cab => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:34.379962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cee39-5160-4465-8f99-23a4f90a44e6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:34.420772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c7dcf-9b5f-4b67-bed2-14982255c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:34.421451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c7dcf-9b5f-4b67-bed2-14982255c934 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:34.421763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c7dcf-9b5f-4b67-bed2-14982255c934 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:34.422035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c7dcf-9b5f-4b67-bed2-14982255c934 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:34.423012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c7dcf-9b5f-4b67-bed2-14982255c934 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:34.423342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c7dcf-9b5f-4b67-bed2-14982255c934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:34.424885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c7dcf-9b5f-4b67-bed2-14982255c934 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:34.430236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 453/909] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:34.436262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be777-1d94-4ad0-87ed-eb76d66a969d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:34.470069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:34.551349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be777-1d94-4ad0-87ed-eb76d66a969d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:34.589756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a930107-b76b-49b1-9a59-8d43bd4d60d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:34.590442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a930107-b76b-49b1-9a59-8d43bd4d60d1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:34.590786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a930107-b76b-49b1-9a59-8d43bd4d60d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:34.591087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a930107-b76b-49b1-9a59-8d43bd4d60d1 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:34.591775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a930107-b76b-49b1-9a59-8d43bd4d60d1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:34.592110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a930107-b76b-49b1-9a59-8d43bd4d60d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:34.594065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a930107-b76b-49b1-9a59-8d43bd4d60d1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:34.599737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 457/910] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:34.605674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c7dcf-9b5f-4b67-bed2-14982255c934 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:34.653478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:34.717424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c7dcf-9b5f-4b67-bed2-14982255c934 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:34.757479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7fc40-e295-40d6-a6d5-d452122f4fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:34.758555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7fc40-e295-40d6-a6d5-d452122f4fbe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:34.759068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7fc40-e295-40d6-a6d5-d452122f4fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:34.759710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7fc40-e295-40d6-a6d5-d452122f4fbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:34.763011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7fc40-e295-40d6-a6d5-d452122f4fbe None admin] RBAC: Adding query filter params (interface=public, service_id=2faeea43033d431cb71d2edba646e692, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:34.763011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7fc40-e295-40d6-a6d5-d452122f4fbe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:34.763011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7fc40-e295-40d6-a6d5-d452122f4fbe None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:34.771281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 454/911] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Aug 4 04:28:34 2022] GET /identity/v3/endpoints?service_id=2faeea43033d431cb71d2edba646e692&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:34.776595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a930107-b76b-49b1-9a59-8d43bd4d60d1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:34.877122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:34.887731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a930107-b76b-49b1-9a59-8d43bd4d60d1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:34.925647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dde61-a82b-48cf-934f-17bcd6579ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:34.926289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dde61-a82b-48cf-934f-17bcd6579ddb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:34.926593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dde61-a82b-48cf-934f-17bcd6579ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:34.926869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dde61-a82b-48cf-934f-17bcd6579ddb None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:34.927605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dde61-a82b-48cf-934f-17bcd6579ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:34.928986 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dde61-a82b-48cf-934f-17bcd6579ddb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:34.936103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 458/912] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Aug 4 04:28:34 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:28:35.517781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8428a2f-b2cb-4543-908b-2395b4e6bee6 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:35.518304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8428a2f-b2cb-4543-908b-2395b4e6bee6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:35.518304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8428a2f-b2cb-4543-908b-2395b4e6bee6 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:35.520075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 455/913] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:35.525402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f487-d23a-4f83-bcbd-f993d149835a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:35.525821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f487-d23a-4f83-bcbd-f993d149835a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:35.526076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f487-d23a-4f83-bcbd-f993d149835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:35.545072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1409f487-d23a-4f83-bcbd-f993d149835a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:35.546262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1409f487-d23a-4f83-bcbd-f993d149835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:35.623246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 459/914] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:35.646143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8428a2f-b2cb-4543-908b-2395b4e6bee6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:35.756566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8428a2f-b2cb-4543-908b-2395b4e6bee6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:35.764179 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:35.793706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcafbf3-68d0-40b5-8d84-cf1d575972a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:35.794265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcafbf3-68d0-40b5-8d84-cf1d575972a7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:35.794548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcafbf3-68d0-40b5-8d84-cf1d575972a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:35.794823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcafbf3-68d0-40b5-8d84-cf1d575972a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:35.795485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcafbf3-68d0-40b5-8d84-cf1d575972a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:35.796928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcafbf3-68d0-40b5-8d84-cf1d575972a7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-abcafbf3-68d0-40b5-8d84-cf1d575972a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:35.806574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:35.807577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:35.808378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 456/915] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:28:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:35.814476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f487-d23a-4f83-bcbd-f993d149835a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:35.916002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:35.934159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a6f36-cf86-47b0-8655-a87955b3dd1b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:35.934488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a6f36-cf86-47b0-8655-a87955b3dd1b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:35.934718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a6f36-cf86-47b0-8655-a87955b3dd1b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:35.936351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 457/916] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:35.940560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f487-d23a-4f83-bcbd-f993d149835a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:35.942479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265fe1e-abe4-4a7f-b4ac-e3dc7ca07153 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:35.942947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265fe1e-abe4-4a7f-b4ac-e3dc7ca07153 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:35.943446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265fe1e-abe4-4a7f-b4ac-e3dc7ca07153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:35.963432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c265fe1e-abe4-4a7f-b4ac-e3dc7ca07153 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:35.965254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c265fe1e-abe4-4a7f-b4ac-e3dc7ca07153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:35.978138 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1ddde-653a-44e8-8415-2f3f2cb5d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:35.978760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1ddde-653a-44e8-8415-2f3f2cb5d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:35.979063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1ddde-653a-44e8-8415-2f3f2cb5d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:35.979340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1ddde-653a-44e8-8415-2f3f2cb5d4ad None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:35.980077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1ddde-653a-44e8-8415-2f3f2cb5d4ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:35.980309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1ddde-653a-44e8-8415-2f3f2cb5d4ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:35.981722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1ddde-653a-44e8-8415-2f3f2cb5d4ad None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:35.987185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 460/917] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:28:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:35.993741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1ddde-653a-44e8-8415-2f3f2cb5d4ad None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.051306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 458/918] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:36.074427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265fe1e-abe4-4a7f-b4ac-e3dc7ca07153 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.112438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1ddde-653a-44e8-8415-2f3f2cb5d4ad None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:36.155841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076dac9-d76f-4397-b7d4-a14e2fd50e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:36.156470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076dac9-d76f-4397-b7d4-a14e2fd50e10 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.156753 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076dac9-d76f-4397-b7d4-a14e2fd50e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.157047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076dac9-d76f-4397-b7d4-a14e2fd50e10 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.157831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076dac9-d76f-4397-b7d4-a14e2fd50e10 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:36.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076dac9-d76f-4397-b7d4-a14e2fd50e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:36.159964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076dac9-d76f-4397-b7d4-a14e2fd50e10 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:36.167647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 461/919] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Aug 4 04:28:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:36.173682 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076dac9-d76f-4397-b7d4-a14e2fd50e10 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.196023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:36.208030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:36.213264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265fe1e-abe4-4a7f-b4ac-e3dc7ca07153 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:36.267882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c6e5-2029-48cd-b67c-f6a203e2fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:36.268529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c6e5-2029-48cd-b67c-f6a203e2fb3d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.268805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c6e5-2029-48cd-b67c-f6a203e2fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.269072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c6e5-2029-48cd-b67c-f6a203e2fb3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.269699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9c6e5-2029-48cd-b67c-f6a203e2fb3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:36.271081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9c6e5-2029-48cd-b67c-f6a203e2fb3d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-11e9c6e5-2029-48cd-b67c-f6a203e2fb3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:36.280762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:36.282052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:36.283102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:36.287210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 459/920] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:36.288497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c6e5-2029-48cd-b67c-f6a203e2fb3d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.326077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076dac9-d76f-4397-b7d4-a14e2fd50e10 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:36.363875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37560d80-5b47-4b74-b185-cbdf9d3737ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:36.364492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37560d80-5b47-4b74-b185-cbdf9d3737ce None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.364769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37560d80-5b47-4b74-b185-cbdf9d3737ce None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.365035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37560d80-5b47-4b74-b185-cbdf9d3737ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.365737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37560d80-5b47-4b74-b185-cbdf9d3737ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:36.367111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37560d80-5b47-4b74-b185-cbdf9d3737ce None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:36.393205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 462/921] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:28:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:36.393205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e3361-4401-45e9-8c9d-544874196073 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.393205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e3361-4401-45e9-8c9d-544874196073 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.393205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e3361-4401-45e9-8c9d-544874196073 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.393205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 463/922] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:36.399367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ff71-94ea-4f48-a68a-b561e1ce5175 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.399697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ff71-94ea-4f48-a68a-b561e1ce5175 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.400739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ff71-94ea-4f48-a68a-b561e1ce5175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.405362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c6e5-2029-48cd-b67c-f6a203e2fb3d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:36.422287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3ce2ff71-94ea-4f48-a68a-b561e1ce5175 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:36.424208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3ce2ff71-94ea-4f48-a68a-b561e1ce5175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:36.451350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e82d4-7f80-46c9-8b4f-64edcd55c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:36.452094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e82d4-7f80-46c9-8b4f-64edcd55c30c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.452374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e82d4-7f80-46c9-8b4f-64edcd55c30c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.452645 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e82d4-7f80-46c9-8b4f-64edcd55c30c None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.453382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e82d4-7f80-46c9-8b4f-64edcd55c30c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:36.453685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e82d4-7f80-46c9-8b4f-64edcd55c30c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:36.455187 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e82d4-7f80-46c9-8b4f-64edcd55c30c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:36.462192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 460/923] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:36.467974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e82d4-7f80-46c9-8b4f-64edcd55c30c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.505293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:36.513534 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:36.525164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 464/924] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:36.549236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2ff71-94ea-4f48-a68a-b561e1ce5175 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.624927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e82d4-7f80-46c9-8b4f-64edcd55c30c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:36.666504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51241feb-41ad-4aef-84fa-941cfa3765c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:36.667548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51241feb-41ad-4aef-84fa-941cfa3765c8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.668129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51241feb-41ad-4aef-84fa-941cfa3765c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.668598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51241feb-41ad-4aef-84fa-941cfa3765c8 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.669484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51241feb-41ad-4aef-84fa-941cfa3765c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:36.669991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51241feb-41ad-4aef-84fa-941cfa3765c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:36.672159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51241feb-41ad-4aef-84fa-941cfa3765c8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:36.677345 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2ff71-94ea-4f48-a68a-b561e1ce5175 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:36.678446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 461/925] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:36.687949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51241feb-41ad-4aef-84fa-941cfa3765c8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.720503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ae703-be88-47a7-8613-28af33063b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:36.721189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ae703-be88-47a7-8613-28af33063b45 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.721468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ae703-be88-47a7-8613-28af33063b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.721739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ae703-be88-47a7-8613-28af33063b45 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.740276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ae703-be88-47a7-8613-28af33063b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e06ae703-be88-47a7-8613-28af33063b45 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:36.747251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:36.748174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:36.749019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:36.752243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 465/926] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Aug 4 04:28:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:36.763277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ae703-be88-47a7-8613-28af33063b45 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.805302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:36.819679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51241feb-41ad-4aef-84fa-941cfa3765c8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:36.833184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:36.857715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8d5ea-8514-43c8-8380-c312a41f14d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:36.858335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d5ea-8514-43c8-8380-c312a41f14d9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.858622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d5ea-8514-43c8-8380-c312a41f14d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.858919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d5ea-8514-43c8-8380-c312a41f14d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.859738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8d5ea-8514-43c8-8380-c312a41f14d9 None admin] RBAC: Adding query filter params (interface=public, service_id=9de3eea4dda547b2be085c7283eadee8, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:36.860049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8d5ea-8514-43c8-8380-c312a41f14d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:36.861418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8d5ea-8514-43c8-8380-c312a41f14d9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:36.867351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 462/927] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Aug 4 04:28:36 2022] GET /identity/v3/endpoints?service_id=9de3eea4dda547b2be085c7283eadee8&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:36.873280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8d5ea-8514-43c8-8380-c312a41f14d9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.887145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ae703-be88-47a7-8613-28af33063b45 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:36.933179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19252-e952-477c-944e-6e1294fc82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:36.933974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19252-e952-477c-944e-6e1294fc82dc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:36.934344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19252-e952-477c-944e-6e1294fc82dc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:36.934706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19252-e952-477c-944e-6e1294fc82dc None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:36.935686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc19252-e952-477c-944e-6e1294fc82dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:36.935941 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc19252-e952-477c-944e-6e1294fc82dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:36.937964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc19252-e952-477c-944e-6e1294fc82dc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:36.950837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 466/928] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Aug 4 04:28:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:36.951924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19252-e952-477c-944e-6e1294fc82dc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:36.997200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8d5ea-8514-43c8-8380-c312a41f14d9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.034267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea15a9-2216-4073-8166-0245ce32529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:37.034943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea15a9-2216-4073-8166-0245ce32529a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.035260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea15a9-2216-4073-8166-0245ce32529a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.035574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea15a9-2216-4073-8166-0245ce32529a None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.036236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea15a9-2216-4073-8166-0245ce32529a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:37.037671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea15a9-2216-4073-8166-0245ce32529a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:37.044504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 463/929] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Aug 4 04:28:36 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:28:37.085018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19252-e952-477c-944e-6e1294fc82dc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.111409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:37.124207 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103b88-2029-4abe-9b58-f67aaf4e7c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:37.124903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103b88-2029-4abe-9b58-f67aaf4e7c19 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.125183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103b88-2029-4abe-9b58-f67aaf4e7c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.125457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103b88-2029-4abe-9b58-f67aaf4e7c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.133641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e3e9-6b27-475d-b79a-d683afb9f982 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.133973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e3e9-6b27-475d-b79a-d683afb9f982 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.134200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e3e9-6b27-475d-b79a-d683afb9f982 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.135942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 464/930] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:37.137843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d103b88-2029-4abe-9b58-f67aaf4e7c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:37.139648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d103b88-2029-4abe-9b58-f67aaf4e7c19 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:37.141862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f68549-871c-484d-94da-34dfb8699078 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.142153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f68549-871c-484d-94da-34dfb8699078 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.142427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f68549-871c-484d-94da-34dfb8699078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-3d103b88-2029-4abe-9b58-f67aaf4e7c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:37.158157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:37.159143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:37.160029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:37.160029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:37.160029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:37.160029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:37.160029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 467/931] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:37.161710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-96f68549-871c-484d-94da-34dfb8699078 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:37.162936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-96f68549-871c-484d-94da-34dfb8699078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:37.165815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103b88-2029-4abe-9b58-f67aaf4e7c19 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:37.179257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:37.261082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 465/932] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:37.284975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f68549-871c-484d-94da-34dfb8699078 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:37.301533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103b88-2029-4abe-9b58-f67aaf4e7c19 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.347284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c3a8b-b208-46aa-b980-6c3cac57ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:37.348161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c3a8b-b208-46aa-b980-6c3cac57ca64 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.348443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c3a8b-b208-46aa-b980-6c3cac57ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.349099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c3a8b-b208-46aa-b980-6c3cac57ca64 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.349851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c3a8b-b208-46aa-b980-6c3cac57ca64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:37.350162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c3a8b-b208-46aa-b980-6c3cac57ca64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:37.352085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c3a8b-b208-46aa-b980-6c3cac57ca64 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:37.369583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 468/933] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:37.375288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c3a8b-b208-46aa-b980-6c3cac57ca64 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:37.409228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f68549-871c-484d-94da-34dfb8699078 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.417149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:37.455967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9b1d0-de90-4060-9fa0-f5000f1e665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:37.457102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9b1d0-de90-4060-9fa0-f5000f1e665c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.457492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9b1d0-de90-4060-9fa0-f5000f1e665c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.457765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9b1d0-de90-4060-9fa0-f5000f1e665c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.458432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9b1d0-de90-4060-9fa0-f5000f1e665c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:37.460713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9b1d0-de90-4060-9fa0-f5000f1e665c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-57a9b1d0-de90-4060-9fa0-f5000f1e665c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:37.472897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:37.474549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 04:28:37.476165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:37.479725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 466/934] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Aug 4 04:28:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:37.480552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9b1d0-de90-4060-9fa0-f5000f1e665c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:37.498196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:37.511640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c3a8b-b208-46aa-b980-6c3cac57ca64 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.556040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7357ac-7564-45f9-9441-3a093abcd0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:37.556697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7357ac-7564-45f9-9441-3a093abcd0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.556978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7357ac-7564-45f9-9441-3a093abcd0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.557256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7357ac-7564-45f9-9441-3a093abcd0a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.567981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7357ac-7564-45f9-9441-3a093abcd0a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:37.569645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7357ac-7564-45f9-9441-3a093abcd0a5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-cd7357ac-7564-45f9-9441-3a093abcd0a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:37.586394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:37.587431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:37.588793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 469/935] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:28:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:37.593166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7357ac-7564-45f9-9441-3a093abcd0a5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:37.620158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9b1d0-de90-4060-9fa0-f5000f1e665c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.670536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334efd14-b4d9-4994-8444-aaacfa375fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:37.671207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efd14-b4d9-4994-8444-aaacfa375fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.672700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efd14-b4d9-4994-8444-aaacfa375fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.673456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334efd14-b4d9-4994-8444-aaacfa375fa8 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.674452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334efd14-b4d9-4994-8444-aaacfa375fa8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:37.674762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334efd14-b4d9-4994-8444-aaacfa375fa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:37.676461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334efd14-b4d9-4994-8444-aaacfa375fa8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:37.687149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 467/936] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:37.691428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334efd14-b4d9-4994-8444-aaacfa375fa8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:37.713316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:37.724050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7357ac-7564-45f9-9441-3a093abcd0a5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.773269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41b4eb-1f26-4514-86ec-aeb21fd8da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:37.774184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b4eb-1f26-4514-86ec-aeb21fd8da64 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.774607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b4eb-1f26-4514-86ec-aeb21fd8da64 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.775053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b4eb-1f26-4514-86ec-aeb21fd8da64 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.776105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41b4eb-1f26-4514-86ec-aeb21fd8da64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:37.776561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41b4eb-1f26-4514-86ec-aeb21fd8da64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:37.778224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41b4eb-1f26-4514-86ec-aeb21fd8da64 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:37.793841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:37.801413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 470/937] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Aug 4 04:28:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:37.809251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41b4eb-1f26-4514-86ec-aeb21fd8da64 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:37.821951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334efd14-b4d9-4994-8444-aaacfa375fa8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.858571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfb309-2c74-4d32-a064-8babb520eed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:37.859899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb309-2c74-4d32-a064-8babb520eed7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.860294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb309-2c74-4d32-a064-8babb520eed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.860711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb309-2c74-4d32-a064-8babb520eed7 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.861572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb309-2c74-4d32-a064-8babb520eed7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:37.861965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb309-2c74-4d32-a064-8babb520eed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:37.863525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb309-2c74-4d32-a064-8babb520eed7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:37.873556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 468/938] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:37.874866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfb309-2c74-4d32-a064-8babb520eed7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:37.916877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41b4eb-1f26-4514-86ec-aeb21fd8da64 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.954052 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4aab6-8dda-4e8e-9fbd-a4f05775186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:37.954694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4aab6-8dda-4e8e-9fbd-a4f05775186f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:37.954972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4aab6-8dda-4e8e-9fbd-a4f05775186f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:37.955269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4aab6-8dda-4e8e-9fbd-a4f05775186f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:37.965971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4aab6-8dda-4e8e-9fbd-a4f05775186f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:37.967538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4aab6-8dda-4e8e-9fbd-a4f05775186f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:37.982168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfb309-2c74-4d32-a064-8babb520eed7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-8cc4aab6-8dda-4e8e-9fbd-a4f05775186f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:37.983013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:37.984395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:37.985271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:37.985271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:37.985271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:37.985271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:37.989647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 471/939] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:37.990489 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4aab6-8dda-4e8e-9fbd-a4f05775186f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:37.993222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:38.022519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1819-1eec-42fc-840d-6a25682cf06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:38.023539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1819-1eec-42fc-840d-6a25682cf06c None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:38.024051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1819-1eec-42fc-840d-6a25682cf06c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:38.024546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1819-1eec-42fc-840d-6a25682cf06c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:38.025388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d1819-1eec-42fc-840d-6a25682cf06c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:38.027079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d1819-1eec-42fc-840d-6a25682cf06c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:38.037133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:38.063153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 469/940] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:28:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:38.110319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4aab6-8dda-4e8e-9fbd-a4f05775186f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:38.153516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5c77e-d69b-44bb-9566-97e069b4d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:38.154141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5c77e-d69b-44bb-9566-97e069b4d485 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:38.154420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5c77e-d69b-44bb-9566-97e069b4d485 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:38.154688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5c77e-d69b-44bb-9566-97e069b4d485 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:38.155420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5c77e-d69b-44bb-9566-97e069b4d485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:38.156239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5c77e-d69b-44bb-9566-97e069b4d485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:38.157625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5c77e-d69b-44bb-9566-97e069b4d485 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:38.171195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 472/941] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:38.177477 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1819-1eec-42fc-840d-6a25682cf06c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:38.291281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1819-1eec-42fc-840d-6a25682cf06c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:38.327996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d865ddd-45e9-44df-9cf8-20a9af5d84d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:38.329015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d865ddd-45e9-44df-9cf8-20a9af5d84d4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:38.329513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d865ddd-45e9-44df-9cf8-20a9af5d84d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:38.329981 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d865ddd-45e9-44df-9cf8-20a9af5d84d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:38.337249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d865ddd-45e9-44df-9cf8-20a9af5d84d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:38.338904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d865ddd-45e9-44df-9cf8-20a9af5d84d4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4d865ddd-45e9-44df-9cf8-20a9af5d84d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:38.351029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:38.351917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:38.352775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:38.352775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:38.352775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:38.352775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:38.352775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:38.352775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:38.352775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:38.352775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:38.355231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 470/942] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:38.363595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5c77e-d69b-44bb-9566-97e069b4d485 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:38.423949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:38.467535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5c77e-d69b-44bb-9566-97e069b4d485 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:38.502894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104489d-6300-4cfe-8b2f-3d260a1bb2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:38.503843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104489d-6300-4cfe-8b2f-3d260a1bb2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:38.504331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104489d-6300-4cfe-8b2f-3d260a1bb2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:38.504775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104489d-6300-4cfe-8b2f-3d260a1bb2f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:38.505698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104489d-6300-4cfe-8b2f-3d260a1bb2f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:38.506175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104489d-6300-4cfe-8b2f-3d260a1bb2f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:38.507786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104489d-6300-4cfe-8b2f-3d260a1bb2f8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:38.521100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 473/943] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:38.527349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d865ddd-45e9-44df-9cf8-20a9af5d84d4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:38.588385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:38.613094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73563631-a734-4f1e-a762-42adfbdba5d6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:38.613606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73563631-a734-4f1e-a762-42adfbdba5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:38.613606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73563631-a734-4f1e-a762-42adfbdba5d6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:38.615131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 474/944] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:38.620357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d584f-2528-40ea-9694-19ebe576acda None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:38.620835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d584f-2528-40ea-9694-19ebe576acda None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:38.621369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d584f-2528-40ea-9694-19ebe576acda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:38.641232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-310d584f-2528-40ea-9694-19ebe576acda None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:38.642282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d865ddd-45e9-44df-9cf8-20a9af5d84d4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:38.643087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-310d584f-2528-40ea-9694-19ebe576acda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:38.687483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22330504-d9ee-4e9c-a911-f0c5cbf3412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:38.688202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330504-d9ee-4e9c-a911-f0c5cbf3412f None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:38.688475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330504-d9ee-4e9c-a911-f0c5cbf3412f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:38.688699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330504-d9ee-4e9c-a911-f0c5cbf3412f None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/fb129070880846549efcb9925c2736c7/roles/b9beb0e1058b4fe0b7c885c46f775cab` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:38.691418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22330504-d9ee-4e9c-a911-f0c5cbf3412f None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=fb129070880846549efcb9925c2736c7, role_id=b9beb0e1058b4fe0b7c885c46f775cab)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:38.693665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22330504-d9ee-4e9c-a911-f0c5cbf3412f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:38.712901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 471/945] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:38 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/fb129070880846549efcb9925c2736c7/roles/b9beb0e1058b4fe0b7c885c46f775cab => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:38.723861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 475/946] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:38.752003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22330504-d9ee-4e9c-a911-f0c5cbf3412f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:38.870813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22330504-d9ee-4e9c-a911-f0c5cbf3412f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:38.886024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:38.910820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca47852-4265-4cf1-b56b-b4336d541592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:38.911469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca47852-4265-4cf1-b56b-b4336d541592 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:38.911749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca47852-4265-4cf1-b56b-b4336d541592 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:38.912016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca47852-4265-4cf1-b56b-b4336d541592 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:38.912693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca47852-4265-4cf1-b56b-b4336d541592 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:38.914119 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca47852-4265-4cf1-b56b-b4336d541592 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:38.916787 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING keystone.server.flask.common [None req-4ca47852-4265-4cf1-b56b-b4336d541592 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 04:28:38.938166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.sql.core [None req-4ca47852-4265-4cf1-b56b-b4336d541592 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 04:28:38.938166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 04:28:38.938166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [parameters: {'id': '6becbda9ee3f4330a9c24e91c4183a4e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 04:28:38.938166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-4ca47852-4265-4cf1-b56b-b4336d541592 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6becbda9ee3f4330a9c24e91c4183a4e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6becbda9ee3f4330a9c24e91c4183a4e. Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:28:38.945636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 04:28:38.946514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application yield resource Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise self.value Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application session.commit() Aug 04 04:28:38.948772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.session.flush() Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application compat.raise_( Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 04:28:38.949909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 04:28:38.953741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application result.read() Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:28:38.954779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [parameters: {'id': '6becbda9ee3f4330a9c24e91c4183a4e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:38.967202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:38.969242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6becbda9ee3f4330a9c24e91c4183a4e. Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:38.971582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 472/947] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Aug 4 04:28:38 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:38.975032 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d584f-2528-40ea-9694-19ebe576acda None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:39.027527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:39.077700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d584f-2528-40ea-9694-19ebe576acda None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:39.114905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b9b90-764a-4477-a5e6-7c30187f1883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:39.115958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b9b90-764a-4477-a5e6-7c30187f1883 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:39.116437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b9b90-764a-4477-a5e6-7c30187f1883 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:39.116903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b9b90-764a-4477-a5e6-7c30187f1883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:39.124051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b9b90-764a-4477-a5e6-7c30187f1883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:39.126337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b9b90-764a-4477-a5e6-7c30187f1883 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:39.134140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34f0b5-6b75-45f9-ae48-f2cafe885e1c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:39.134423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34f0b5-6b75-45f9-ae48-f2cafe885e1c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:39.134699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34f0b5-6b75-45f9-ae48-f2cafe885e1c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-301b9b90-764a-4477-a5e6-7c30187f1883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:39.138945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:39.139826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:39.141456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:39.141456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:39.141456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:39.141456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:39.141456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:39.141456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:39.141456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:39.141456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:39.143285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 473/948] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:39.144032 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 476/949] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:39.148707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189e3b2-9fbb-4ac1-b184-19739c7b88a1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:39.148707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189e3b2-9fbb-4ac1-b184-19739c7b88a1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:39.148707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189e3b2-9fbb-4ac1-b184-19739c7b88a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:39.149938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b9b90-764a-4477-a5e6-7c30187f1883 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:39.164150 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c189e3b2-9fbb-4ac1-b184-19739c7b88a1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:39.165673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c189e3b2-9fbb-4ac1-b184-19739c7b88a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:39.248958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 474/950] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:39.262683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b9b90-764a-4477-a5e6-7c30187f1883 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:39.272504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189e3b2-9fbb-4ac1-b184-19739c7b88a1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:39.284894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:39.321850 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da01ff-5edb-4633-a807-75504d1820d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:39.322221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da01ff-5edb-4633-a807-75504d1820d7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:39.322572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da01ff-5edb-4633-a807-75504d1820d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:39.323021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da01ff-5edb-4633-a807-75504d1820d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:39.331418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da01ff-5edb-4633-a807-75504d1820d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:39.331418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da01ff-5edb-4633-a807-75504d1820d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:39.331418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da01ff-5edb-4633-a807-75504d1820d7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:39.352538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 477/951] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:39.399668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:39.403543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189e3b2-9fbb-4ac1-b184-19739c7b88a1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:39.443774 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdd7be-ad18-420b-bc6f-83d03314a3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:39.444499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdd7be-ad18-420b-bc6f-83d03314a3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:39.444777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdd7be-ad18-420b-bc6f-83d03314a3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:39.445043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdd7be-ad18-420b-bc6f-83d03314a3e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:39.445736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdd7be-ad18-420b-bc6f-83d03314a3e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:39.447368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdd7be-ad18-420b-bc6f-83d03314a3e3 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7ffdd7be-ad18-420b-bc6f-83d03314a3e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:39.457299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:39.458414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:39.459323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 475/952] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:39.468619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da01ff-5edb-4633-a807-75504d1820d7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:39.583526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da01ff-5edb-4633-a807-75504d1820d7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:39.620215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e07c25-f315-4aaa-be38-6b5d4de8ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:39.620945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07c25-f315-4aaa-be38-6b5d4de8ec28 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:39.621104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07c25-f315-4aaa-be38-6b5d4de8ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:39.621355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07c25-f315-4aaa-be38-6b5d4de8ec28 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:39.622035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e07c25-f315-4aaa-be38-6b5d4de8ec28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:39.622341 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e07c25-f315-4aaa-be38-6b5d4de8ec28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:39.623763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e07c25-f315-4aaa-be38-6b5d4de8ec28 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:39.629491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 478/953] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:39.635935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdd7be-ad18-420b-bc6f-83d03314a3e3 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:39.766673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdd7be-ad18-420b-bc6f-83d03314a3e3 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:39.803163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2818a7-9e6b-4057-a84c-d2494184b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:39.803787 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2818a7-9e6b-4057-a84c-d2494184b48c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:39.804123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2818a7-9e6b-4057-a84c-d2494184b48c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:39.804404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2818a7-9e6b-4057-a84c-d2494184b48c None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:39.805089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2818a7-9e6b-4057-a84c-d2494184b48c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:39.805394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2818a7-9e6b-4057-a84c-d2494184b48c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:39.806767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2818a7-9e6b-4057-a84c-d2494184b48c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:39.812980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 476/954] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:39.818425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e07c25-f315-4aaa-be38-6b5d4de8ec28 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:39.855030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:39.928211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e07c25-f315-4aaa-be38-6b5d4de8ec28 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:39.964777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef54fb-03f9-4b0e-ba2a-7f77869d2f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:39.965405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef54fb-03f9-4b0e-ba2a-7f77869d2f00 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:39.965687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef54fb-03f9-4b0e-ba2a-7f77869d2f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:39.965959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef54fb-03f9-4b0e-ba2a-7f77869d2f00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:39.966757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef54fb-03f9-4b0e-ba2a-7f77869d2f00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:39.968203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef54fb-03f9-4b0e-ba2a-7f77869d2f00 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:39.993652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 479/955] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:28:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:40.253908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910be8-b360-406c-a18d-f86e8ce7833d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:40.254293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910be8-b360-406c-a18d-f86e8ce7833d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:40.254486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb910be8-b360-406c-a18d-f86e8ce7833d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:40.256117 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 477/956] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:40.261175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42dcb-7949-45f7-b699-57c3eb2ce430 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:40.261800 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42dcb-7949-45f7-b699-57c3eb2ce430 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:40.262274 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f42dcb-7949-45f7-b699-57c3eb2ce430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:40.280458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-64f42dcb-7949-45f7-b699-57c3eb2ce430 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:40.282454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-64f42dcb-7949-45f7-b699-57c3eb2ce430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:40.360092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 480/957] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:40.381994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb910be8-b360-406c-a18d-f86e8ce7833d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:40.412180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:40.488465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb910be8-b360-406c-a18d-f86e8ce7833d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:40.524162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2c036-5237-4a11-8557-ef8b1498806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:40.524710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2c036-5237-4a11-8557-ef8b1498806f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:40.524988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2c036-5237-4a11-8557-ef8b1498806f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:40.525260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2c036-5237-4a11-8557-ef8b1498806f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:40.526030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2c036-5237-4a11-8557-ef8b1498806f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:40.527452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2c036-5237-4a11-8557-ef8b1498806f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-eda2c036-5237-4a11-8557-ef8b1498806f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:40.536821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:40.537829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:40.538653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 478/958] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:40.545981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42dcb-7949-45f7-b699-57c3eb2ce430 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:40.561628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:40.656782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f42dcb-7949-45f7-b699-57c3eb2ce430 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:40.695415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d939a-3e30-4e75-9813-8d0900b806d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:40.696047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d939a-3e30-4e75-9813-8d0900b806d9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:40.696323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d939a-3e30-4e75-9813-8d0900b806d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:40.696591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d939a-3e30-4e75-9813-8d0900b806d9 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:40.697271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d939a-3e30-4e75-9813-8d0900b806d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:40.697569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d939a-3e30-4e75-9813-8d0900b806d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:40.698942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d939a-3e30-4e75-9813-8d0900b806d9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:40.705177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 481/959] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:40.712573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2c036-5237-4a11-8557-ef8b1498806f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:40.819084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:40.829364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2c036-5237-4a11-8557-ef8b1498806f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:40.865134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c4d11-aee3-49c4-9bdf-984a43fa8d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:40.865747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c4d11-aee3-49c4-9bdf-984a43fa8d64 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:40.866024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c4d11-aee3-49c4-9bdf-984a43fa8d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:40.866298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c4d11-aee3-49c4-9bdf-984a43fa8d64 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:40.866974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c4d11-aee3-49c4-9bdf-984a43fa8d64 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:40.867302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c4d11-aee3-49c4-9bdf-984a43fa8d64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:40.868654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c4d11-aee3-49c4-9bdf-984a43fa8d64 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:40.873583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 479/960] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:40.917833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21a132-d3fe-4451-997e-1d08851848e2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:40.918148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21a132-d3fe-4451-997e-1d08851848e2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:40.918387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21a132-d3fe-4451-997e-1d08851848e2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:40.920108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 482/961] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:40.926255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875ceb-b058-47a5-944f-0ee8b2c86e97 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:40.926582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875ceb-b058-47a5-944f-0ee8b2c86e97 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:40.926798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875ceb-b058-47a5-944f-0ee8b2c86e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:40.946271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0b875ceb-b058-47a5-944f-0ee8b2c86e97 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:40.947520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0b875ceb-b058-47a5-944f-0ee8b2c86e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:41.023279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 480/962] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:41.050908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21a132-d3fe-4451-997e-1d08851848e2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:41.143837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:41.171149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21a132-d3fe-4451-997e-1d08851848e2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:41.209044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3880f1-77ec-478e-a765-8598d965ee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:41.209688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3880f1-77ec-478e-a765-8598d965ee79 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:41.209969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3880f1-77ec-478e-a765-8598d965ee79 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:41.210245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3880f1-77ec-478e-a765-8598d965ee79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:41.221143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3880f1-77ec-478e-a765-8598d965ee79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-aa3880f1-77ec-478e-a765-8598d965ee79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:41.226185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:41.227132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:41.227950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 483/963] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Aug 4 04:28:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:41.233474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b875ceb-b058-47a5-944f-0ee8b2c86e97 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:41.324021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:41.340690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b875ceb-b058-47a5-944f-0ee8b2c86e97 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:41.377575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b05c8-e62a-452f-a5d5-334b5dfe47a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:41.378481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b05c8-e62a-452f-a5d5-334b5dfe47a9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:41.378966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b05c8-e62a-452f-a5d5-334b5dfe47a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:41.379464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b05c8-e62a-452f-a5d5-334b5dfe47a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:41.380342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b05c8-e62a-452f-a5d5-334b5dfe47a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:41.380813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b05c8-e62a-452f-a5d5-334b5dfe47a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:41.382385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b05c8-e62a-452f-a5d5-334b5dfe47a9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:41.391606 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 481/964] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Aug 4 04:28:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:41.400448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3880f1-77ec-478e-a765-8598d965ee79 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:41.508924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3880f1-77ec-478e-a765-8598d965ee79 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:41.545222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e284d-9b1b-4028-9a29-c132697109f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:41.545864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e284d-9b1b-4028-9a29-c132697109f0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:41.546143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e284d-9b1b-4028-9a29-c132697109f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:41.546446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e284d-9b1b-4028-9a29-c132697109f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:41.553660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:41.557728 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e284d-9b1b-4028-9a29-c132697109f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:41.559289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e284d-9b1b-4028-9a29-c132697109f0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-214e284d-9b1b-4028-9a29-c132697109f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:41.574708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:41.575660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:41.576546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:41.576546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:41.576546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:41.576546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:41.576546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 484/965] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:41.582194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b05c8-e62a-452f-a5d5-334b5dfe47a9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:41.683645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20bb90-52cd-4623-9069-1ed06c55c037 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:41.684301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20bb90-52cd-4623-9069-1ed06c55c037 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:41.684301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20bb90-52cd-4623-9069-1ed06c55c037 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:41.685798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 485/966] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:41.692047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bdfa3-b571-4142-b8e7-12777881e475 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:41.692429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bdfa3-b571-4142-b8e7-12777881e475 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:41.692759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bdfa3-b571-4142-b8e7-12777881e475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:41.696504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b05c8-e62a-452f-a5d5-334b5dfe47a9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:41.711825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-811bdfa3-b571-4142-b8e7-12777881e475 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:41.713020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-811bdfa3-b571-4142-b8e7-12777881e475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:41.746248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89d67-feda-4f05-a74c-579ca32c7cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:41.746888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89d67-feda-4f05-a74c-579ca32c7cea None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:41.747200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89d67-feda-4f05-a74c-579ca32c7cea None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:41.747476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b89d67-feda-4f05-a74c-579ca32c7cea None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:41.748248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b89d67-feda-4f05-a74c-579ca32c7cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:41.748556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b89d67-feda-4f05-a74c-579ca32c7cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:41.750103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b89d67-feda-4f05-a74c-579ca32c7cea None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:41.768373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 482/967] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:41.773505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89d67-feda-4f05-a74c-579ca32c7cea None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:41.791351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:41.817680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 486/968] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:41.844615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bdfa3-b571-4142-b8e7-12777881e475 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:41.885564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b89d67-feda-4f05-a74c-579ca32c7cea None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:41.931081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f9cb0-63c0-425c-9324-f40ccd8bfdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:41.932156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f9cb0-63c0-425c-9324-f40ccd8bfdcc None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:41.932643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f9cb0-63c0-425c-9324-f40ccd8bfdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:41.933116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f9cb0-63c0-425c-9324-f40ccd8bfdcc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:41.943923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f9cb0-63c0-425c-9324-f40ccd8bfdcc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:41.946129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f9cb0-63c0-425c-9324-f40ccd8bfdcc None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:41.961244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bdfa3-b571-4142-b8e7-12777881e475 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c44f9cb0-63c0-425c-9324-f40ccd8bfdcc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:41.964399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:41.965318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 04:28:41.966240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:41.969890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 483/969] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:28:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:41.974882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f9cb0-63c0-425c-9324-f40ccd8bfdcc None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:41.988463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:42.005685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:42.006393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.006622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.006916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.007601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:42.009020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:42.011722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WARNING keystone.server.flask.common [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 04:28:42.026575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.sql.core [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 04:28:42.026575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 04:28:42.026575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [parameters: {'user_id': 'e5f76916d5ae4c309efc9fc24e12f508', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 04:28:42.026575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80399) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Aug 04 04:28:42.044096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:28:42.045023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application yield resource Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application next(self.gen) Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise self.value Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application session.commit() Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 04:28:42.046137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.session.flush() Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application compat.raise_( Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 04:28:42.047720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 04:28:42.048773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application conn.query(q) Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application result.read() Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 04:28:42.049793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e5f76916d5ae4c309efc9fc24e12f508', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:42.050804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 04:28:42.051953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 04:28:42.053089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 04:28:42.053089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 04:28:42.053089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 04:28:42.053089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 04:28:42.053089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 04:28:42.053089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:42.053089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 487/970] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Aug 4 04:28:41 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:42.054571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:42.068242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:42.109756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f9cb0-63c0-425c-9324-f40ccd8bfdcc None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:42.146488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844941c8-d7a1-41eb-81e5-498d5fd10afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:42.147412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844941c8-d7a1-41eb-81e5-498d5fd10afa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.147686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844941c8-d7a1-41eb-81e5-498d5fd10afa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.147949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844941c8-d7a1-41eb-81e5-498d5fd10afa None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.149180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844941c8-d7a1-41eb-81e5-498d5fd10afa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:42.149180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844941c8-d7a1-41eb-81e5-498d5fd10afa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:42.150428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844941c8-d7a1-41eb-81e5-498d5fd10afa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:42.169669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 484/971] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Aug 4 04:28:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:42.170858 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636201c-794e-4f65-86f9-6b410c0bdeec None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.171175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636201c-794e-4f65-86f9-6b410c0bdeec None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.171976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636201c-794e-4f65-86f9-6b410c0bdeec None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.177341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 485/972] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:42.177341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636201c-794e-4f65-86f9-6b410c0bdeec None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:42.185769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94e732-4ce4-41f2-b87b-7b83eb62178d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:42.219985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69913fc-38fb-481d-8c2c-4dd54ff0b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:42.220669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69913fc-38fb-481d-8c2c-4dd54ff0b66b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.220950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69913fc-38fb-481d-8c2c-4dd54ff0b66b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.221223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69913fc-38fb-481d-8c2c-4dd54ff0b66b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.229100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69913fc-38fb-481d-8c2c-4dd54ff0b66b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:42.230718 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69913fc-38fb-481d-8c2c-4dd54ff0b66b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a69913fc-38fb-481d-8c2c-4dd54ff0b66b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:42.242842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:42.244003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:42.245068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 488/973] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:42.245746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894f33b-557f-4c41-8a04-f305c9273c23 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.245813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894f33b-557f-4c41-8a04-f305c9273c23 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.246058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894f33b-557f-4c41-8a04-f305c9273c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.264035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c894f33b-557f-4c41-8a04-f305c9273c23 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:42.265566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c894f33b-557f-4c41-8a04-f305c9273c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:42.291179 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636201c-794e-4f65-86f9-6b410c0bdeec None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:42.301793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:42.322349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:42.332803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3f2f6-2670-45e8-b5b0-69f7c37480e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:42.333550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3f2f6-2670-45e8-b5b0-69f7c37480e5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.333843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3f2f6-2670-45e8-b5b0-69f7c37480e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.334088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3f2f6-2670-45e8-b5b0-69f7c37480e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.336782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 489/974] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:42.343915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894f33b-557f-4c41-8a04-f305c9273c23 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:42.408757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3f2f6-2670-45e8-b5b0-69f7c37480e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:42.410322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3f2f6-2670-45e8-b5b0-69f7c37480e5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:42.450190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894f33b-557f-4c41-8a04-f305c9273c23 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:42.486610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7da27-f03e-49c9-a3cd-90f3bdbc070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:42.487188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7da27-f03e-49c9-a3cd-90f3bdbc070c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.487470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7da27-f03e-49c9-a3cd-90f3bdbc070c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.487739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7da27-f03e-49c9-a3cd-90f3bdbc070c None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.488498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7da27-f03e-49c9-a3cd-90f3bdbc070c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:42.488800 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7da27-f03e-49c9-a3cd-90f3bdbc070c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:42.490223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7da27-f03e-49c9-a3cd-90f3bdbc070c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:42.517310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 486/975] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:42 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:42.518498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3f2f6-2670-45e8-b5b0-69f7c37480e5 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:42.535034 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 490/976] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Aug 4 04:28:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:42.535034 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7da27-f03e-49c9-a3cd-90f3bdbc070c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:42.564722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:42.570543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:42.664447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7da27-f03e-49c9-a3cd-90f3bdbc070c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:42.676810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3f2f6-2670-45e8-b5b0-69f7c37480e5 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:42.709368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3941166-2e7f-4015-b876-5732c6078ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:42.710162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941166-2e7f-4015-b876-5732c6078ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.710446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941166-2e7f-4015-b876-5732c6078ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.710720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941166-2e7f-4015-b876-5732c6078ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.721892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3941166-2e7f-4015-b876-5732c6078ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:42.723183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809f81-6ff3-464c-b48e-6c0118824afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:42.723833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809f81-6ff3-464c-b48e-6c0118824afa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.724112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809f81-6ff3-464c-b48e-6c0118824afa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.724213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3941166-2e7f-4015-b876-5732c6078ba6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:42.724379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809f81-6ff3-464c-b48e-6c0118824afa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.725207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809f81-6ff3-464c-b48e-6c0118824afa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:42.726719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809f81-6ff3-464c-b48e-6c0118824afa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-21809f81-6ff3-464c-b48e-6c0118824afa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:42.738442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:42.739709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:42.740580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 487/977] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c3941166-2e7f-4015-b876-5732c6078ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:42.746638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:42.747577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:42.749212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:42.749212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:42.749212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:42.749212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:42.749212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 491/978] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:42.749897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809f81-6ff3-464c-b48e-6c0118824afa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:42.750418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3941166-2e7f-4015-b876-5732c6078ba6 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:42.863240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:42.871384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:42.882298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809f81-6ff3-464c-b48e-6c0118824afa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:42.886498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3941166-2e7f-4015-b876-5732c6078ba6 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:42.917857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e85f-36dd-4e9d-8941-92e9d8b13770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:42.919093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e85f-36dd-4e9d-8941-92e9d8b13770 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.919378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e85f-36dd-4e9d-8941-92e9d8b13770 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.919709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e85f-36dd-4e9d-8941-92e9d8b13770 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.920330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4e85f-36dd-4e9d-8941-92e9d8b13770 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:42.920678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4e85f-36dd-4e9d-8941-92e9d8b13770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:42.922914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4e85f-36dd-4e9d-8941-92e9d8b13770 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:42.923414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f9e6-cbff-4345-a97d-6ede806a2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:42.924141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f9e6-cbff-4345-a97d-6ede806a2e4a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:42.924418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f9e6-cbff-4345-a97d-6ede806a2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:42.924791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f9e6-cbff-4345-a97d-6ede806a2e4a None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:42.925468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4f9e6-cbff-4345-a97d-6ede806a2e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:42.925768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4f9e6-cbff-4345-a97d-6ede806a2e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:42.927127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4f9e6-cbff-4345-a97d-6ede806a2e4a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:42.928088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 488/979] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:42.933718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e85f-36dd-4e9d-8941-92e9d8b13770 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:42.949552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 492/980] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:42.950314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f9e6-cbff-4345-a97d-6ede806a2e4a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:43.048165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e85f-36dd-4e9d-8941-92e9d8b13770 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:43.056563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f9e6-cbff-4345-a97d-6ede806a2e4a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:43.080947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d1c99-dd67-4afa-ace5-1dda145d5d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:43.081556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1c99-dd67-4afa-ace5-1dda145d5d20 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:43.081836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1c99-dd67-4afa-ace5-1dda145d5d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:43.082115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d1c99-dd67-4afa-ace5-1dda145d5d20 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:43.082788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d1c99-dd67-4afa-ace5-1dda145d5d20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:43.083122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d1c99-dd67-4afa-ace5-1dda145d5d20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:43.084496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d1c99-dd67-4afa-ace5-1dda145d5d20 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:43.089226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 489/981] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:43.090430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eb2a2-78f3-4d78-a1ce-99550e4a9e11 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:43.090715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eb2a2-78f3-4d78-a1ce-99550e4a9e11 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:43.091004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eb2a2-78f3-4d78-a1ce-99550e4a9e11 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:43.092224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 490/982] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:43.095996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2eb2a2-78f3-4d78-a1ce-99550e4a9e11 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:43.097938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2752e4a-81b2-46cb-aecc-0fa6578ee6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:43.098573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752e4a-81b2-46cb-aecc-0fa6578ee6fe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:43.098845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752e4a-81b2-46cb-aecc-0fa6578ee6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:43.099145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2752e4a-81b2-46cb-aecc-0fa6578ee6fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:43.106014 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2752e4a-81b2-46cb-aecc-0fa6578ee6fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:43.107463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2752e4a-81b2-46cb-aecc-0fa6578ee6fe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:43.115865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-e2752e4a-81b2-46cb-aecc-0fa6578ee6fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:43.119128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:43.120310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 493/983] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9ec14-bddc-40d0-8311-2fbc0de76762 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:43.121883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9ec14-bddc-40d0-8311-2fbc0de76762 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:43.122515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9ec14-bddc-40d0-8311-2fbc0de76762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:43.128506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:43.141336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8eb9ec14-bddc-40d0-8311-2fbc0de76762 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:43.142522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8eb9ec14-bddc-40d0-8311-2fbc0de76762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:43.204615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2eb2a2-78f3-4d78-a1ce-99550e4a9e11 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:43.210888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 494/984] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:43.212188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9ec14-bddc-40d0-8311-2fbc0de76762 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:43.238852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcb114-946e-458a-8eae-6d88f431c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:43.239487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb114-946e-458a-8eae-6d88f431c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:43.239761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb114-946e-458a-8eae-6d88f431c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:43.240027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb114-946e-458a-8eae-6d88f431c7f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:43.240778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcb114-946e-458a-8eae-6d88f431c7f9 None admin] RBAC: Adding query filter params (interface=admin, service_id=9de3eea4dda547b2be085c7283eadee8, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:43.241085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcb114-946e-458a-8eae-6d88f431c7f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:43.242463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcb114-946e-458a-8eae-6d88f431c7f9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:43.247435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 491/985] 10.222.0.57 () {56 vars in 1249 bytes} [Thu Aug 4 04:28:43 2022] GET /identity/v3/endpoints?service_id=9de3eea4dda547b2be085c7283eadee8&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:43.248171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcb114-946e-458a-8eae-6d88f431c7f9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:43.312812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9ec14-bddc-40d0-8311-2fbc0de76762 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:43.329770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:43.342058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:43.347278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20cefe-86b0-43f2-9df5-ffecef277a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:43.347892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20cefe-86b0-43f2-9df5-ffecef277a05 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:43.348169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20cefe-86b0-43f2-9df5-ffecef277a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:43.348346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcb114-946e-458a-8eae-6d88f431c7f9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:43.348467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20cefe-86b0-43f2-9df5-ffecef277a05 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:43.349162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20cefe-86b0-43f2-9df5-ffecef277a05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:43.349461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20cefe-86b0-43f2-9df5-ffecef277a05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:43.350882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20cefe-86b0-43f2-9df5-ffecef277a05 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:43.362143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 495/986] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:43.362921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20cefe-86b0-43f2-9df5-ffecef277a05 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:43.382267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4e33b-c8fe-42df-8ea4-518d8072a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:43.382875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e33b-c8fe-42df-8ea4-518d8072a06a None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:43.383192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e33b-c8fe-42df-8ea4-518d8072a06a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:43.383461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4e33b-c8fe-42df-8ea4-518d8072a06a None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:43.384146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4e33b-c8fe-42df-8ea4-518d8072a06a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:43.385491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4e33b-c8fe-42df-8ea4-518d8072a06a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:43.415017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 492/987] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:28:43 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:43.415017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4e33b-c8fe-42df-8ea4-518d8072a06a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:43.483734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20cefe-86b0-43f2-9df5-ffecef277a05 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:43.536994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4e33b-c8fe-42df-8ea4-518d8072a06a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:43.540494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40684c0-5f72-436e-a70e-589b84cc1ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:43.540717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40684c0-5f72-436e-a70e-589b84cc1ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:43.541072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40684c0-5f72-436e-a70e-589b84cc1ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:43.541410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40684c0-5f72-436e-a70e-589b84cc1ae8 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:43.542141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40684c0-5f72-436e-a70e-589b84cc1ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:43.543656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40684c0-5f72-436e-a70e-589b84cc1ae8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:43.559030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 496/988] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Aug 4 04:28:43 2022] GET /identity/v3/services => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:28:43.587578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23210569-d48f-428a-9a0c-0a704b775ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:43.588138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210569-d48f-428a-9a0c-0a704b775ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:43.588421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210569-d48f-428a-9a0c-0a704b775ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:43.588693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23210569-d48f-428a-9a0c-0a704b775ae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:43.589533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23210569-d48f-428a-9a0c-0a704b775ae4 None admin] RBAC: Adding query filter params (role.id=b9beb0e1058b4fe0b7c885c46f775cab, scope.project.id=642faef2d1654874bd7205420512998a, user.id=fb129070880846549efcb9925c2736c7) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:43.589827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23210569-d48f-428a-9a0c-0a704b775ae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:43.591384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23210569-d48f-428a-9a0c-0a704b775ae4 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:43.603095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 493/989] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:43 2022] GET /identity/v3/role_assignments?user.id=fb129070880846549efcb9925c2736c7&scope.project.id=642faef2d1654874bd7205420512998a&role.id=b9beb0e1058b4fe0b7c885c46f775cab => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:45.440640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ac621-2841-4d07-b4dc-71a324b098a0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:45.441191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ac621-2841-4d07-b4dc-71a324b098a0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:45.441191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ac621-2841-4d07-b4dc-71a324b098a0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:45.442675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 497/990] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:45.447571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60c679-5095-4e21-a6ec-c31b8700d3e7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:45.447945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60c679-5095-4e21-a6ec-c31b8700d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:45.448119 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60c679-5095-4e21-a6ec-c31b8700d3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:45.454918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:45.470814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ea60c679-5095-4e21-a6ec-c31b8700d3e7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:45.472034 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ea60c679-5095-4e21-a6ec-c31b8700d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:45.540217 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 494/991] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:45.552205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e5b12-2ef7-4dc9-941f-d84ae97be6d3 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:45.552494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e5b12-2ef7-4dc9-941f-d84ae97be6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:45.552759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e5b12-2ef7-4dc9-941f-d84ae97be6d3 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:45.554223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 498/992] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:45.559126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3d8f8-592f-48a9-80ae-0603844ad1ee None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:45.559411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3d8f8-592f-48a9-80ae-0603844ad1ee None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:45.559684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3d8f8-592f-48a9-80ae-0603844ad1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:45.562581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e5b12-2ef7-4dc9-941f-d84ae97be6d3 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:45.579924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-06b3d8f8-592f-48a9-80ae-0603844ad1ee None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:45.581240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-06b3d8f8-592f-48a9-80ae-0603844ad1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:45.630200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:45.656453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 495/993] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:45.679581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3d8f8-592f-48a9-80ae-0603844ad1ee None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:45.686174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e5b12-2ef7-4dc9-941f-d84ae97be6d3 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:45.720888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244c285-65b7-4f00-84bf-1521e6b7cc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:45.721444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244c285-65b7-4f00-84bf-1521e6b7cc21 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:45.721722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244c285-65b7-4f00-84bf-1521e6b7cc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:45.721993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244c285-65b7-4f00-84bf-1521e6b7cc21 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:45.722615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244c285-65b7-4f00-84bf-1521e6b7cc21 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:45.724017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244c285-65b7-4f00-84bf-1521e6b7cc21 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-2244c285-65b7-4f00-84bf-1521e6b7cc21 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:45.732993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:45.734684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:45.736114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 499/994] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:45.736897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a6640-4eb2-47fe-a226-fc5a4a2958aa None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:45.737092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a6640-4eb2-47fe-a226-fc5a4a2958aa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:45.737278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a6640-4eb2-47fe-a226-fc5a4a2958aa None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:45.738697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 500/995] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:45.743186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a6640-4eb2-47fe-a226-fc5a4a2958aa None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:45.744401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:45.784875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3d8f8-592f-48a9-80ae-0603844ad1ee None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:45.820581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855650d-0d82-4c5a-ac32-546bacdffc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:45.821295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855650d-0d82-4c5a-ac32-546bacdffc7f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:45.821579 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855650d-0d82-4c5a-ac32-546bacdffc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:45.821850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855650d-0d82-4c5a-ac32-546bacdffc7f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:45.822559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855650d-0d82-4c5a-ac32-546bacdffc7f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:45.824129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855650d-0d82-4c5a-ac32-546bacdffc7f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-0855650d-0d82-4c5a-ac32-546bacdffc7f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:45.833390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:45.834557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:45.835423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 496/996] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Aug 4 04:28:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:45.836202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80fd0-5240-4875-852d-8ae2765b9e21 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:45.836268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80fd0-5240-4875-852d-8ae2765b9e21 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:45.836525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80fd0-5240-4875-852d-8ae2765b9e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:45.849862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a6640-4eb2-47fe-a226-fc5a4a2958aa None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:45.855305 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-77d80fd0-5240-4875-852d-8ae2765b9e21 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:45.856495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-77d80fd0-5240-4875-852d-8ae2765b9e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:45.868405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:45.886341 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997efd9-e7dc-4a47-96f0-3b9ad2ded9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:45.886959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997efd9-e7dc-4a47-96f0-3b9ad2ded9af None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:45.887270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997efd9-e7dc-4a47-96f0-3b9ad2ded9af None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:45.887553 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997efd9-e7dc-4a47-96f0-3b9ad2ded9af None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:45.888231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997efd9-e7dc-4a47-96f0-3b9ad2ded9af None admin] RBAC: Adding query filter params (name=compute) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:45.888533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997efd9-e7dc-4a47-96f0-3b9ad2ded9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:45.890373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997efd9-e7dc-4a47-96f0-3b9ad2ded9af None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:45.895072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 501/997] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:45.902266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997efd9-e7dc-4a47-96f0-3b9ad2ded9af None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:45.926880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 497/998] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:45.927761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80fd0-5240-4875-852d-8ae2765b9e21 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:45.983077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:46.011480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997efd9-e7dc-4a47-96f0-3b9ad2ded9af None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:46.026925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80fd0-5240-4875-852d-8ae2765b9e21 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:46.052131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74a145-4b07-44c7-a712-4c23f430d916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:46.052833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74a145-4b07-44c7-a712-4c23f430d916 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:46.053353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74a145-4b07-44c7-a712-4c23f430d916 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:46.053353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74a145-4b07-44c7-a712-4c23f430d916 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:46.054024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74a145-4b07-44c7-a712-4c23f430d916 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:46.054324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74a145-4b07-44c7-a712-4c23f430d916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:46.055688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74a145-4b07-44c7-a712-4c23f430d916 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:46.060301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 502/999] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:46.060649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3228034-b72e-4ac3-8615-4fa381dbcb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:46.061060 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74a145-4b07-44c7-a712-4c23f430d916 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:46.061266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3228034-b72e-4ac3-8615-4fa381dbcb3d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:46.061546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3228034-b72e-4ac3-8615-4fa381dbcb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:46.061865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3228034-b72e-4ac3-8615-4fa381dbcb3d None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:46.062537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3228034-b72e-4ac3-8615-4fa381dbcb3d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:46.062833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3228034-b72e-4ac3-8615-4fa381dbcb3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:46.064223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3228034-b72e-4ac3-8615-4fa381dbcb3d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:46.073649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 498/1000] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:46.073649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3228034-b72e-4ac3-8615-4fa381dbcb3d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:46.114540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:46.168524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74a145-4b07-44c7-a712-4c23f430d916 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:46.171595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3228034-b72e-4ac3-8615-4fa381dbcb3d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:46.191156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:46.202091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56645311-3546-4fbe-bf09-1b1d8a72c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:46.203264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56645311-3546-4fbe-bf09-1b1d8a72c62c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:46.203540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56645311-3546-4fbe-bf09-1b1d8a72c62c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:46.203814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56645311-3546-4fbe-bf09-1b1d8a72c62c None admin] PATH_INFO: `/v3/services/image` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:46.204423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56645311-3546-4fbe-bf09-1b1d8a72c62c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:46.205767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56645311-3546-4fbe-bf09-1b1d8a72c62c None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:46.206628 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579292a-225c-427c-9eb0-2161295c9e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:46.207264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579292a-225c-427c-9eb0-2161295c9e51 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:46.207547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579292a-225c-427c-9eb0-2161295c9e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:46.207818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579292a-225c-427c-9eb0-2161295c9e51 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:46.208492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579292a-225c-427c-9eb0-2161295c9e51 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:46.208792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579292a-225c-427c-9eb0-2161295c9e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:46.210132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579292a-225c-427c-9eb0-2161295c9e51 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-56645311-3546-4fbe-bf09-1b1d8a72c62c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:46.214612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:46.215819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:46.216752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 503/1001] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Aug 4 04:28:46 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:46.217605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 499/1002] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Aug 4 04:28:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:46.217677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56645311-3546-4fbe-bf09-1b1d8a72c62c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:46.221775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579292a-225c-427c-9eb0-2161295c9e51 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:46.321952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56645311-3546-4fbe-bf09-1b1d8a72c62c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:46.323122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579292a-225c-427c-9eb0-2161295c9e51 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:46.330705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:46.356177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd747a-e038-467e-b9eb-0cecfc0e8485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:46.356791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd747a-e038-467e-b9eb-0cecfc0e8485 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:46.357071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd747a-e038-467e-b9eb-0cecfc0e8485 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:46.357173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1ed31-c8ae-4be3-96b5-5f11a21543da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:46.357346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd747a-e038-467e-b9eb-0cecfc0e8485 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:46.357676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1ed31-c8ae-4be3-96b5-5f11a21543da None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:46.357955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1ed31-c8ae-4be3-96b5-5f11a21543da None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:46.358094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd747a-e038-467e-b9eb-0cecfc0e8485 None admin] RBAC: Adding query filter params (interface=public, service_id=8ac2125f6f37469e8da142ad410f7a77, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:46.358224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1ed31-c8ae-4be3-96b5-5f11a21543da None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:46.358402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd747a-e038-467e-b9eb-0cecfc0e8485 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:46.359498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1ed31-c8ae-4be3-96b5-5f11a21543da None admin] RBAC: Adding query filter params (name=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:46.359801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1ed31-c8ae-4be3-96b5-5f11a21543da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:46.360419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd747a-e038-467e-b9eb-0cecfc0e8485 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:46.361146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1ed31-c8ae-4be3-96b5-5f11a21543da None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:46.365404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 504/1003] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Aug 4 04:28:46 2022] GET /identity/v3/endpoints?service_id=8ac2125f6f37469e8da142ad410f7a77&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:46.370550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 500/1004] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:46.370691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd747a-e038-467e-b9eb-0cecfc0e8485 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:46.371086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1ed31-c8ae-4be3-96b5-5f11a21543da None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:46.422893 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:46.466873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd747a-e038-467e-b9eb-0cecfc0e8485 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:46.472927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1ed31-c8ae-4be3-96b5-5f11a21543da None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:46.500319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e38cc6-14c8-44c7-b4c0-9fd4767aff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:46.500928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38cc6-14c8-44c7-b4c0-9fd4767aff13 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:46.501239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38cc6-14c8-44c7-b4c0-9fd4767aff13 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:46.501588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38cc6-14c8-44c7-b4c0-9fd4767aff13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:46.502284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e38cc6-14c8-44c7-b4c0-9fd4767aff13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:46.503666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e38cc6-14c8-44c7-b4c0-9fd4767aff13 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:46.512062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790dd3-be25-4477-9096-91a990b29aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:46.512850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790dd3-be25-4477-9096-91a990b29aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:46.513211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790dd3-be25-4477-9096-91a990b29aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:46.513632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790dd3-be25-4477-9096-91a990b29aa7 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:46.514339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd790dd3-be25-4477-9096-91a990b29aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:46.517966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd790dd3-be25-4477-9096-91a990b29aa7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:46.524473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 501/1005] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Aug 4 04:28:46 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:28:46.535017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790dd3-be25-4477-9096-91a990b29aa7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:46.535297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 505/1006] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:28:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:46.659132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790dd3-be25-4477-9096-91a990b29aa7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:46.675458 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:46.705983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97a2c4-2fea-4544-bf87-5cc0fab23c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:46.706605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97a2c4-2fea-4544-bf87-5cc0fab23c3b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:46.706888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97a2c4-2fea-4544-bf87-5cc0fab23c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:46.707194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97a2c4-2fea-4544-bf87-5cc0fab23c3b None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:46.707871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97a2c4-2fea-4544-bf87-5cc0fab23c3b None admin] RBAC: Adding query filter params (type=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:46.708178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97a2c4-2fea-4544-bf87-5cc0fab23c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:46.709555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97a2c4-2fea-4544-bf87-5cc0fab23c3b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:46.714692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 502/1007] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:48.588094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0594-46d0-4dae-8c64-270e440f4eaa None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:48.588654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0594-46d0-4dae-8c64-270e440f4eaa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:48.588654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0594-46d0-4dae-8c64-270e440f4eaa None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:48.589975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 506/1008] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:48.597057 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78781d8-c6b2-4e7d-af9e-80d24587f95e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:48.597520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78781d8-c6b2-4e7d-af9e-80d24587f95e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:48.597618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78781d8-c6b2-4e7d-af9e-80d24587f95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:48.618017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d78781d8-c6b2-4e7d-af9e-80d24587f95e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:48.619232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d78781d8-c6b2-4e7d-af9e-80d24587f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:48.671114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3a84-91fa-4c89-b03e-f1ade8dab419 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:48.671406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3a84-91fa-4c89-b03e-f1ade8dab419 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:48.671683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb3a84-91fa-4c89-b03e-f1ade8dab419 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:48.673303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 507/1009] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:48.678355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e168f6a-4117-46d6-9d3b-e85a615af8d4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:48.678636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e168f6a-4117-46d6-9d3b-e85a615af8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:48.678916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e168f6a-4117-46d6-9d3b-e85a615af8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:48.695033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 503/1010] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:48.697273 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8e168f6a-4117-46d6-9d3b-e85a615af8d4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:48.698572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8e168f6a-4117-46d6-9d3b-e85a615af8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:48.713973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1eb2-e68e-483b-99b6-6fc519690800 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:48.714272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1eb2-e68e-483b-99b6-6fc519690800 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:48.714529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1eb2-e68e-483b-99b6-6fc519690800 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:48.716425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 504/1011] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:48.720235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1eb2-e68e-483b-99b6-6fc519690800 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:48.727178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:48.771443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 508/1012] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:48.772707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491062aa-89da-4f4e-a35c-9623d323d072 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:48.772992 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491062aa-89da-4f4e-a35c-9623d323d072 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:48.773264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491062aa-89da-4f4e-a35c-9623d323d072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:48.795434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-491062aa-89da-4f4e-a35c-9623d323d072 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:48.796726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-491062aa-89da-4f4e-a35c-9623d323d072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:48.825787 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba1eb2-e68e-483b-99b6-6fc519690800 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:48.828142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:48.863351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 509/1013] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:48.863532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ca410-86ac-45e4-9c05-72d0abb399af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:48.864168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ca410-86ac-45e4-9c05-72d0abb399af None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:48.864273 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491062aa-89da-4f4e-a35c-9623d323d072 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:48.864455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ca410-86ac-45e4-9c05-72d0abb399af None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:48.864728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ca410-86ac-45e4-9c05-72d0abb399af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:48.865899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ca410-86ac-45e4-9c05-72d0abb399af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:48.867384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ca410-86ac-45e4-9c05-72d0abb399af None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:48.873683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 505/1014] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:48.875354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ca410-86ac-45e4-9c05-72d0abb399af None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:48.960290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:48.970003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491062aa-89da-4f4e-a35c-9623d323d072 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:48.973752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ca410-86ac-45e4-9c05-72d0abb399af None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:49.006448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0694ec-6384-4781-a4ce-42042a9148a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:49.007107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0694ec-6384-4781-a4ce-42042a9148a8 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:49.007394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0694ec-6384-4781-a4ce-42042a9148a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:49.007662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0694ec-6384-4781-a4ce-42042a9148a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:49.008280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0694ec-6384-4781-a4ce-42042a9148a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:49.009656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e590-266e-4557-89e6-9d4e23caf332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:49.009775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0694ec-6384-4781-a4ce-42042a9148a8 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:49.010259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e590-266e-4557-89e6-9d4e23caf332 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:49.010536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e590-266e-4557-89e6-9d4e23caf332 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:49.010808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e590-266e-4557-89e6-9d4e23caf332 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:49.011584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435e590-266e-4557-89e6-9d4e23caf332 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:49.012976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435e590-266e-4557-89e6-9d4e23caf332 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-2e0694ec-6384-4781-a4ce-42042a9148a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:49.018806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:49.020061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:49.020890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 510/1015] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:49.021677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0694ec-6384-4781-a4ce-42042a9148a8 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:49.042168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 506/1016] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:28:48 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:28:49.043021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e590-266e-4557-89e6-9d4e23caf332 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:49.079734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:49.148376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0694ec-6384-4781-a4ce-42042a9148a8 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:49.168760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e590-266e-4557-89e6-9d4e23caf332 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:49.185729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c545e-179c-4f08-a3d9-58a9e6d7302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:49.186352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c545e-179c-4f08-a3d9-58a9e6d7302f None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:49.186748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c545e-179c-4f08-a3d9-58a9e6d7302f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:49.187658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c545e-179c-4f08-a3d9-58a9e6d7302f None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:49.188265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c545e-179c-4f08-a3d9-58a9e6d7302f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:49.189682 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c545e-179c-4f08-a3d9-58a9e6d7302f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:49.207916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 511/1017] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:28:49 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:49.223666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55e992-2bac-44df-8462-d09d068d674a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:49.224681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55e992-2bac-44df-8462-d09d068d674a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:49.225165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55e992-2bac-44df-8462-d09d068d674a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:49.225751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55e992-2bac-44df-8462-d09d068d674a None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:49.226738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55e992-2bac-44df-8462-d09d068d674a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:49.227128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55e992-2bac-44df-8462-d09d068d674a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:49.228567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55e992-2bac-44df-8462-d09d068d674a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:49.235245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 507/1018] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:49.241351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c545e-179c-4f08-a3d9-58a9e6d7302f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:49.263660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:49.361041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c545e-179c-4f08-a3d9-58a9e6d7302f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:49.396661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709934ac-bd78-452d-b941-b7ad9cff61d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:49.397421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709934ac-bd78-452d-b941-b7ad9cff61d0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:49.397808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709934ac-bd78-452d-b941-b7ad9cff61d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:49.398081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709934ac-bd78-452d-b941-b7ad9cff61d0 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:49.398940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709934ac-bd78-452d-b941-b7ad9cff61d0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:49.399301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709934ac-bd78-452d-b941-b7ad9cff61d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:49.400987 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709934ac-bd78-452d-b941-b7ad9cff61d0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:49.409123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 512/1019] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Aug 4 04:28:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:49.415879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55e992-2bac-44df-8462-d09d068d674a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:49.503878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:49.524226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55e992-2bac-44df-8462-d09d068d674a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:49.559292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f5b68-3c72-411c-9a4d-278f21be808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:49.559912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5b68-3c72-411c-9a4d-278f21be808b None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:49.560189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5b68-3c72-411c-9a4d-278f21be808b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:49.560459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5b68-3c72-411c-9a4d-278f21be808b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:49.561163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f5b68-3c72-411c-9a4d-278f21be808b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:49.563271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f5b68-3c72-411c-9a4d-278f21be808b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:49.585446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 508/1020] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:28:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:28:51.148280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4bcf7-88e0-4731-ba52-248b675dabc1 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.148780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4bcf7-88e0-4731-ba52-248b675dabc1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.148780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4bcf7-88e0-4731-ba52-248b675dabc1 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.150253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 513/1021] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:51.155340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591e324-2af8-4dee-8954-6f851295394a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.155727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591e324-2af8-4dee-8954-6f851295394a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.155932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591e324-2af8-4dee-8954-6f851295394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.175089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8591e324-2af8-4dee-8954-6f851295394a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:51.176283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8591e324-2af8-4dee-8954-6f851295394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:51.238545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c64c41-94b6-4136-9ec2-909e598c68a0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.238875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c64c41-94b6-4136-9ec2-909e598c68a0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.239136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c64c41-94b6-4136-9ec2-909e598c68a0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.240619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 514/1022] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:51.245347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809f2c7-7bf6-4303-bfc0-ac483202aed5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.245636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809f2c7-7bf6-4303-bfc0-ac483202aed5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.245912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809f2c7-7bf6-4303-bfc0-ac483202aed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.252484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 509/1023] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:51.263852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4809f2c7-7bf6-4303-bfc0-ac483202aed5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:51.265559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4809f2c7-7bf6-4303-bfc0-ac483202aed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:51.276729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591e324-2af8-4dee-8954-6f851295394a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:51.335785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 515/1024] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:51.342202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:51.358648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809f2c7-7bf6-4303-bfc0-ac483202aed5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:51.370749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:51.387799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591e324-2af8-4dee-8954-6f851295394a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:51.428101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9271f67-7dba-4523-b391-4ef44cc852dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:51.428649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9271f67-7dba-4523-b391-4ef44cc852dd None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.429213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9271f67-7dba-4523-b391-4ef44cc852dd None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.429213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9271f67-7dba-4523-b391-4ef44cc852dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.430352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9271f67-7dba-4523-b391-4ef44cc852dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:51.431838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9271f67-7dba-4523-b391-4ef44cc852dd None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:51.433871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 510/1025] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:51.439451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9271f67-7dba-4523-b391-4ef44cc852dd None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:51.484958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809f2c7-7bf6-4303-bfc0-ac483202aed5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:51.522535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2157-62b6-4b4f-bfcd-20d6db2691fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:51.523216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2157-62b6-4b4f-bfcd-20d6db2691fe None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.523499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2157-62b6-4b4f-bfcd-20d6db2691fe None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.523771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea2157-62b6-4b4f-bfcd-20d6db2691fe None admin] PATH_INFO: `/v3/services/image` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.524399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea2157-62b6-4b4f-bfcd-20d6db2691fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:51.525760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea2157-62b6-4b4f-bfcd-20d6db2691fe None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f4ea2157-62b6-4b4f-bfcd-20d6db2691fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:51.534891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:51.535920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:51.536746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 516/1026] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Aug 4 04:28:51 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:51.542032 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2157-62b6-4b4f-bfcd-20d6db2691fe None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:51.550066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9271f67-7dba-4523-b391-4ef44cc852dd None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:51.584749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:51.591335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee547c-10ce-4cc4-9967-534b93d783b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:51.591950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee547c-10ce-4cc4-9967-534b93d783b1 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.592228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee547c-10ce-4cc4-9967-534b93d783b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.592491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee547c-10ce-4cc4-9967-534b93d783b1 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.593220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee547c-10ce-4cc4-9967-534b93d783b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:51.594635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee547c-10ce-4cc4-9967-534b93d783b1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:51.617984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 511/1027] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:28:51 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:28:51.636261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:51.666417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea2157-62b6-4b4f-bfcd-20d6db2691fe None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:51.707203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53264da9-27d2-4e2b-a65c-50785f2124fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:51.707904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264da9-27d2-4e2b-a65c-50785f2124fc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.708186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264da9-27d2-4e2b-a65c-50785f2124fc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.708464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264da9-27d2-4e2b-a65c-50785f2124fc None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.709140 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53264da9-27d2-4e2b-a65c-50785f2124fc None admin] RBAC: Adding query filter params (name=image) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:51.709449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53264da9-27d2-4e2b-a65c-50785f2124fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:51.710836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53264da9-27d2-4e2b-a65c-50785f2124fc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:51.711364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666177-d513-4d9b-8f59-7393d2eb2b91 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.711654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666177-d513-4d9b-8f59-7393d2eb2b91 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.711928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666177-d513-4d9b-8f59-7393d2eb2b91 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.713542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 512/1028] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:51.721638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 517/1029] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:51.721827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90a549-ce8a-4544-ae34-02d86c85e2c7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.721827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90a549-ce8a-4544-ae34-02d86c85e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.721827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90a549-ce8a-4544-ae34-02d86c85e2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.722937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53264da9-27d2-4e2b-a65c-50785f2124fc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:51.740907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8e90a549-ce8a-4544-ae34-02d86c85e2c7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:51.742149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8e90a549-ce8a-4544-ae34-02d86c85e2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:51.845056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 513/1030] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:51.863816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53264da9-27d2-4e2b-a65c-50785f2124fc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:51.868264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90a549-ce8a-4544-ae34-02d86c85e2c7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:51.899108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613149d-b0cd-45c7-9f12-0fbfc48c2822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:51.899658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613149d-b0cd-45c7-9f12-0fbfc48c2822 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:51.899940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613149d-b0cd-45c7-9f12-0fbfc48c2822 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:51.900212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613149d-b0cd-45c7-9f12-0fbfc48c2822 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:51.900886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613149d-b0cd-45c7-9f12-0fbfc48c2822 None admin] RBAC: Adding query filter params (type=image) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:51.901182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613149d-b0cd-45c7-9f12-0fbfc48c2822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:51.902540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613149d-b0cd-45c7-9f12-0fbfc48c2822 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:51.907895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 518/1031] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:51.913186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613149d-b0cd-45c7-9f12-0fbfc48c2822 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:51.915844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:51.979926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90a549-ce8a-4544-ae34-02d86c85e2c7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:52.001710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:52.020555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613149d-b0cd-45c7-9f12-0fbfc48c2822 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:52.023548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561aa5-45b9-4304-8c31-0c7a67694ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:52.024183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561aa5-45b9-4304-8c31-0c7a67694ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:52.024459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561aa5-45b9-4304-8c31-0c7a67694ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:52.024732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561aa5-45b9-4304-8c31-0c7a67694ff2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:52.035318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82561aa5-45b9-4304-8c31-0c7a67694ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-82561aa5-45b9-4304-8c31-0c7a67694ff2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:52.040322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:52.041245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:52.042066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 514/1032] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Aug 4 04:28:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:52.048309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561aa5-45b9-4304-8c31-0c7a67694ff2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:52.063732 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913e17-791e-4044-b458-9933f2591ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:52.064787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913e17-791e-4044-b458-9933f2591ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:52.065707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913e17-791e-4044-b458-9933f2591ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:52.066263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913e17-791e-4044-b458-9933f2591ed0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:52.067295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68913e17-791e-4044-b458-9933f2591ed0 None admin] RBAC: Adding query filter params (interface=public, service_id=6175063bd5984cedb79862de04b929c0, region_id=RegionOne) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:52.068001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68913e17-791e-4044-b458-9933f2591ed0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:52.069887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68913e17-791e-4044-b458-9933f2591ed0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:52.076707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 519/1033] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Aug 4 04:28:51 2022] GET /identity/v3/endpoints?service_id=6175063bd5984cedb79862de04b929c0&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:52.082421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913e17-791e-4044-b458-9933f2591ed0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:52.155684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561aa5-45b9-4304-8c31-0c7a67694ff2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:52.179071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:52.215100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816227-c46e-4369-be04-07f2d1c78150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:52.215721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816227-c46e-4369-be04-07f2d1c78150 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:52.216038 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816227-c46e-4369-be04-07f2d1c78150 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:52.216345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816227-c46e-4369-be04-07f2d1c78150 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:52.217177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e816227-c46e-4369-be04-07f2d1c78150 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:52.217478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e816227-c46e-4369-be04-07f2d1c78150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:52.219195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e816227-c46e-4369-be04-07f2d1c78150 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:52.221516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913e17-791e-4044-b458-9933f2591ed0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:52.228113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 515/1034] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Aug 4 04:28:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:52.234369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816227-c46e-4369-be04-07f2d1c78150 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:52.264822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9e54c-f839-4155-96b4-363a652d1a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:52.265617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9e54c-f839-4155-96b4-363a652d1a4b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:52.266164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9e54c-f839-4155-96b4-363a652d1a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:52.266447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9e54c-f839-4155-96b4-363a652d1a4b None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:52.267642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9e54c-f839-4155-96b4-363a652d1a4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:52.269128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9e54c-f839-4155-96b4-363a652d1a4b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:52.277491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:52.280861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 520/1035] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Aug 4 04:28:52 2022] GET /identity/v3/services => generated 1957 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:28:52.355172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816227-c46e-4369-be04-07f2d1c78150 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:52.393577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2276b5d-607b-4353-aed6-69149c51fbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:52.394236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2276b5d-607b-4353-aed6-69149c51fbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:52.394510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2276b5d-607b-4353-aed6-69149c51fbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:52.394783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2276b5d-607b-4353-aed6-69149c51fbb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:52.408424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2276b5d-607b-4353-aed6-69149c51fbb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:52.409899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2276b5d-607b-4353-aed6-69149c51fbb9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c2276b5d-607b-4353-aed6-69149c51fbb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:52.426570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:52.427572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:52.428455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:52.428455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:52.428455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:52.428455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:52.434171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 516/1036] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:52.434318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9e54c-f839-4155-96b4-363a652d1a4b None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:52.542077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9e54c-f839-4155-96b4-363a652d1a4b None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:52.571878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:52.579575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf5bcf-b3da-46a4-84bd-0a309e109ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:52.579804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf5bcf-b3da-46a4-84bd-0a309e109ebd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:52.580091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf5bcf-b3da-46a4-84bd-0a309e109ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:52.580571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf5bcf-b3da-46a4-84bd-0a309e109ebd None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:52.581039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf5bcf-b3da-46a4-84bd-0a309e109ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:52.581947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf5bcf-b3da-46a4-84bd-0a309e109ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:52.582685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf5bcf-b3da-46a4-84bd-0a309e109ebd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:52.598380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 521/1037] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:52.604131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2276b5d-607b-4353-aed6-69149c51fbb9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:52.699216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:52.710400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2276b5d-607b-4353-aed6-69149c51fbb9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:52.751028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae3653-15dd-4db2-aa2d-1d2c32f53bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:52.751675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae3653-15dd-4db2-aa2d-1d2c32f53bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:52.751953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae3653-15dd-4db2-aa2d-1d2c32f53bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:52.752227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae3653-15dd-4db2-aa2d-1d2c32f53bb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:52.764764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae3653-15dd-4db2-aa2d-1d2c32f53bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:52.766273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae3653-15dd-4db2-aa2d-1d2c32f53bb1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c1ae3653-15dd-4db2-aa2d-1d2c32f53bb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:52.778483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:52.779526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:52.780478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 517/1038] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Aug 4 04:28:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:52.785440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf5bcf-b3da-46a4-84bd-0a309e109ebd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:52.889946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf5bcf-b3da-46a4-84bd-0a309e109ebd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:52.924493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee32783-4012-41c9-9435-339f1026db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:52.925113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee32783-4012-41c9-9435-339f1026db7a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:52.925393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee32783-4012-41c9-9435-339f1026db7a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:52.925665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee32783-4012-41c9-9435-339f1026db7a None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:52.926459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee32783-4012-41c9-9435-339f1026db7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:52.926762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee32783-4012-41c9-9435-339f1026db7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:52.928246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee32783-4012-41c9-9435-339f1026db7a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:52.950665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 522/1039] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Aug 4 04:28:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:52.951867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae3653-15dd-4db2-aa2d-1d2c32f53bb1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:53.055235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae3653-15dd-4db2-aa2d-1d2c32f53bb1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:53.088997 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeb77c-1020-4e8e-8e6b-e2ddc7441847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:53.089608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeb77c-1020-4e8e-8e6b-e2ddc7441847 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:53.089888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeb77c-1020-4e8e-8e6b-e2ddc7441847 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:53.090167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beeb77c-1020-4e8e-8e6b-e2ddc7441847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:53.111566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:53.159935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beeb77c-1020-4e8e-8e6b-e2ddc7441847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:53.161225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beeb77c-1020-4e8e-8e6b-e2ddc7441847 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:53.270104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 518/1040] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:52 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:53.271401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee32783-4012-41c9-9435-339f1026db7a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:53.321924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:53.377017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee32783-4012-41c9-9435-339f1026db7a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:53.417942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dee513-1d7b-4681-91ca-3e2198ef2b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:53.418493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dee513-1d7b-4681-91ca-3e2198ef2b14 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:53.418769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dee513-1d7b-4681-91ca-3e2198ef2b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:53.419140 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dee513-1d7b-4681-91ca-3e2198ef2b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:53.431310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dee513-1d7b-4681-91ca-3e2198ef2b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:53.432873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dee513-1d7b-4681-91ca-3e2198ef2b14 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-03dee513-1d7b-4681-91ca-3e2198ef2b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:53.448189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:53.449078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:53.449928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:53.449928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:53.449928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:53.449928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:53.451305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 523/1041] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:53.455538 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeb77c-1020-4e8e-8e6b-e2ddc7441847 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:53.509167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:53.557516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beeb77c-1020-4e8e-8e6b-e2ddc7441847 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:53.594711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4809c-f3bb-416d-b26e-96a3f33ccda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:53.595530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4809c-f3bb-416d-b26e-96a3f33ccda0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:53.595886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4809c-f3bb-416d-b26e-96a3f33ccda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:53.596156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4809c-f3bb-416d-b26e-96a3f33ccda0 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:53.596842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4809c-f3bb-416d-b26e-96a3f33ccda0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:53.597139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4809c-f3bb-416d-b26e-96a3f33ccda0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:53.598479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4809c-f3bb-416d-b26e-96a3f33ccda0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:53.610060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 519/1042] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:53.615477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dee513-1d7b-4681-91ca-3e2198ef2b14 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:53.710342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e3b4-635d-4fcd-8c7c-c5db1031137d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:53.710975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e3b4-635d-4fcd-8c7c-c5db1031137d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:53.712623 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e3b4-635d-4fcd-8c7c-c5db1031137d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:53.714872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 520/1043] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:53.715818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:53.721046 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dee513-1d7b-4681-91ca-3e2198ef2b14 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:53.721317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114c5f-4b50-4698-b5cb-85b7b79a4e35 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:53.721611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114c5f-4b50-4698-b5cb-85b7b79a4e35 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:53.721890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8114c5f-4b50-4698-b5cb-85b7b79a4e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:53.742273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d8114c5f-4b50-4698-b5cb-85b7b79a4e35 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:53.743497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d8114c5f-4b50-4698-b5cb-85b7b79a4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:53.766660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1faa2-04a7-42f3-b314-86f753950bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:53.767347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1faa2-04a7-42f3-b314-86f753950bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:53.767621 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1faa2-04a7-42f3-b314-86f753950bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:53.767888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1faa2-04a7-42f3-b314-86f753950bd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:53.774924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1faa2-04a7-42f3-b314-86f753950bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:53.776383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1faa2-04a7-42f3-b314-86f753950bd5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-49b1faa2-04a7-42f3-b314-86f753950bd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:53.790003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:53.790963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:53.792370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:53.792370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:53.792370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:53.792370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:53.792370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:53.792370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:53.792370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:53.792370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:53.795149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 524/1044] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:53.797413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1faa2-04a7-42f3-b314-86f753950bd5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:53.827027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 521/1045] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:53.845929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8114c5f-4b50-4698-b5cb-85b7b79a4e35 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:53.890944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:53.914849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1faa2-04a7-42f3-b314-86f753950bd5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:53.950140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8114c5f-4b50-4698-b5cb-85b7b79a4e35 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:53.952772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cdbec-7045-4231-ba28-9384183e30dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:53.953395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cdbec-7045-4231-ba28-9384183e30dd None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:53.953663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cdbec-7045-4231-ba28-9384183e30dd None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:53.953931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cdbec-7045-4231-ba28-9384183e30dd None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:53.954674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cdbec-7045-4231-ba28-9384183e30dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:53.954974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cdbec-7045-4231-ba28-9384183e30dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:53.956413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cdbec-7045-4231-ba28-9384183e30dd None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:53.974670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 525/1046] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:53.975329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cdbec-7045-4231-ba28-9384183e30dd None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:53.991047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1d4e6-20cb-40e1-b27c-6be3bcf8d42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:53.991699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d4e6-20cb-40e1-b27c-6be3bcf8d42c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:53.991969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d4e6-20cb-40e1-b27c-6be3bcf8d42c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:53.992245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d4e6-20cb-40e1-b27c-6be3bcf8d42c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:53.999282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:54.003154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1d4e6-20cb-40e1-b27c-6be3bcf8d42c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-fcf1d4e6-20cb-40e1-b27c-6be3bcf8d42c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:54.008294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:54.009229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:54.011843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 522/1047] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:54.015838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1d4e6-20cb-40e1-b27c-6be3bcf8d42c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:54.097346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cdbec-7045-4231-ba28-9384183e30dd None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:54.124771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1d4e6-20cb-40e1-b27c-6be3bcf8d42c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:54.126477 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:54.133890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddac01-b640-4ea2-9bc7-134720db0519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:54.134508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddac01-b640-4ea2-9bc7-134720db0519 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:54.134788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddac01-b640-4ea2-9bc7-134720db0519 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:54.135088 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddac01-b640-4ea2-9bc7-134720db0519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:54.135899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddac01-b640-4ea2-9bc7-134720db0519 None admin] RBAC: Adding query filter params (role.id=b9beb0e1058b4fe0b7c885c46f775cab, scope.project.id=642faef2d1654874bd7205420512998a, user.id=bd26e2ac2578438e854d51d8eed26463) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:54.136208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddac01-b640-4ea2-9bc7-134720db0519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:54.137622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddac01-b640-4ea2-9bc7-134720db0519 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:54.151064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 526/1048] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:53 2022] GET /identity/v3/role_assignments?user.id=bd26e2ac2578438e854d51d8eed26463&scope.project.id=642faef2d1654874bd7205420512998a&role.id=b9beb0e1058b4fe0b7c885c46f775cab => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:54.176598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae769122-226f-4fc5-bac8-e1cc44cc3f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:54.177290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769122-226f-4fc5-bac8-e1cc44cc3f69 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:54.177632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769122-226f-4fc5-bac8-e1cc44cc3f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:54.177906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae769122-226f-4fc5-bac8-e1cc44cc3f69 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:54.178695 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae769122-226f-4fc5-bac8-e1cc44cc3f69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:54.179087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae769122-226f-4fc5-bac8-e1cc44cc3f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:54.180490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae769122-226f-4fc5-bac8-e1cc44cc3f69 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:54.190541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 523/1049] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:54.196848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddac01-b640-4ea2-9bc7-134720db0519 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:54.293421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:54.314425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddac01-b640-4ea2-9bc7-134720db0519 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:54.338505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5337f-053c-4b6c-ae0c-7df8737d2e92 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:54.338786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5337f-053c-4b6c-ae0c-7df8737d2e92 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:54.339088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5337f-053c-4b6c-ae0c-7df8737d2e92 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:54.340573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 524/1050] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:28:54.346450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b8731-b696-44f4-be6a-353af599d653 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:54.346731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b8731-b696-44f4-be6a-353af599d653 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:54.347022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b8731-b696-44f4-be6a-353af599d653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:54.353298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127eea-2e77-44d8-8f53-6aca35d8c196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:54.354053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127eea-2e77-44d8-8f53-6aca35d8c196 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:54.354437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127eea-2e77-44d8-8f53-6aca35d8c196 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:54.354808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127eea-2e77-44d8-8f53-6aca35d8c196 None admin] PATH_INFO: `/v3/users/68d0b863feac48e5b46c166789f79e94` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:54.367712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a09b8731-b696-44f4-be6a-353af599d653 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:54.368747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a09b8731-b696-44f4-be6a-353af599d653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:54.370252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d127eea-2e77-44d8-8f53-6aca35d8c196 None admin] RBAC: Authorizing `identity:get_user(user_id=68d0b863feac48e5b46c166789f79e94)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:54.371843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d127eea-2e77-44d8-8f53-6aca35d8c196 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:54.373824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 527/1051] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:28:54 2022] GET /identity/v3/users/68d0b863feac48e5b46c166789f79e94 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:54.379695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127eea-2e77-44d8-8f53-6aca35d8c196 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:54.447029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 525/1052] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:54.468399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b8731-b696-44f4-be6a-353af599d653 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:54.485880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127eea-2e77-44d8-8f53-6aca35d8c196 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:54.533061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233d415-ee85-4c1a-9e1e-558481754b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:54.533779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233d415-ee85-4c1a-9e1e-558481754b27 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:54.534168 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233d415-ee85-4c1a-9e1e-558481754b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:54.534516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233d415-ee85-4c1a-9e1e-558481754b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:54.549215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:54.583709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:54.592600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b8731-b696-44f4-be6a-353af599d653 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:54.612458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233d415-ee85-4c1a-9e1e-558481754b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:54.613969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233d415-ee85-4c1a-9e1e-558481754b27 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:54.636929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b809c-0d13-4b00-a84a-98e6bd77e9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:54.638254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b809c-0d13-4b00-a84a-98e6bd77e9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:54.638688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b809c-0d13-4b00-a84a-98e6bd77e9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:54.639390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b809c-0d13-4b00-a84a-98e6bd77e9f8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:54.640371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b809c-0d13-4b00-a84a-98e6bd77e9f8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:54.642498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b809c-0d13-4b00-a84a-98e6bd77e9f8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6a0b809c-0d13-4b00-a84a-98e6bd77e9f8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:54.653764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:54.654978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 04:28:54.656583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:54.661829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 526/1053] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Aug 4 04:28:54 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:54.662678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b809c-0d13-4b00-a84a-98e6bd77e9f8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:54.726914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 528/1054] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 04:28:54.728206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233d415-ee85-4c1a-9e1e-558481754b27 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:54.781274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b809c-0d13-4b00-a84a-98e6bd77e9f8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:54.781516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:54.819214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04045-d848-4e71-a36f-e5b05f9a46b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:54.819717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04045-d848-4e71-a36f-e5b05f9a46b6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:54.819957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04045-d848-4e71-a36f-e5b05f9a46b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:54.820228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04045-d848-4e71-a36f-e5b05f9a46b6 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:54.820921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c04045-d848-4e71-a36f-e5b05f9a46b6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:54.821227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c04045-d848-4e71-a36f-e5b05f9a46b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:54.822589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c04045-d848-4e71-a36f-e5b05f9a46b6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:54.832938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 527/1055] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:54.833602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04045-d848-4e71-a36f-e5b05f9a46b6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:54.845000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233d415-ee85-4c1a-9e1e-558481754b27 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:54.860202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:54.884406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097169-9eec-4a6f-a826-35302d939dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:54.885053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097169-9eec-4a6f-a826-35302d939dfb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:54.885331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097169-9eec-4a6f-a826-35302d939dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:54.886349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31097169-9eec-4a6f-a826-35302d939dfb None admin] PATH_INFO: `/v3/projects/3a42170f1e564196aac3054ee17f9763` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:54.887592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31097169-9eec-4a6f-a826-35302d939dfb None admin] RBAC: Authorizing `identity:get_project(project_id=3a42170f1e564196aac3054ee17f9763)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:54.889021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31097169-9eec-4a6f-a826-35302d939dfb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:54.893599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 529/1056] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:28:54 2022] GET /identity/v3/projects/3a42170f1e564196aac3054ee17f9763 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:54.906796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097169-9eec-4a6f-a826-35302d939dfb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:54.966235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04045-d848-4e71-a36f-e5b05f9a46b6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:55.004495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24fc83-bb00-4aa7-bf7a-dad81a881108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:55.005116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24fc83-bb00-4aa7-bf7a-dad81a881108 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:55.005392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24fc83-bb00-4aa7-bf7a-dad81a881108 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:55.005661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24fc83-bb00-4aa7-bf7a-dad81a881108 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:55.006627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24fc83-bb00-4aa7-bf7a-dad81a881108 None admin] RBAC: Adding query filter params (type=image) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:55.006627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24fc83-bb00-4aa7-bf7a-dad81a881108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:55.008011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24fc83-bb00-4aa7-bf7a-dad81a881108 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:55.018378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 528/1057] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:55.019210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31097169-9eec-4a6f-a826-35302d939dfb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:55.019359 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24fc83-bb00-4aa7-bf7a-dad81a881108 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:55.030366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:55.058161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e02a49-0a1d-4d56-9306-dbd40c9c4209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:55.058777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e02a49-0a1d-4d56-9306-dbd40c9c4209 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:55.059097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e02a49-0a1d-4d56-9306-dbd40c9c4209 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:55.059369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e02a49-0a1d-4d56-9306-dbd40c9c4209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:55.060151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e02a49-0a1d-4d56-9306-dbd40c9c4209 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=3a42170f1e564196aac3054ee17f9763, user.id=68d0b863feac48e5b46c166789f79e94) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:55.060453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e02a49-0a1d-4d56-9306-dbd40c9c4209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:55.062007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e02a49-0a1d-4d56-9306-dbd40c9c4209 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:55.067516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 530/1058] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:28:54 2022] GET /identity/v3/role_assignments?user.id=68d0b863feac48e5b46c166789f79e94&scope.project.id=3a42170f1e564196aac3054ee17f9763&role.id=c1429555635349208e8b2bd908436746 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:55.128841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:55.146658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24fc83-bb00-4aa7-bf7a-dad81a881108 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:55.188278 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810478f-67ca-419a-900d-ed71ac4a9ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:55.188920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810478f-67ca-419a-900d-ed71ac4a9ed9 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:55.189176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810478f-67ca-419a-900d-ed71ac4a9ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:55.189448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810478f-67ca-419a-900d-ed71ac4a9ed9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:55.190166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810478f-67ca-419a-900d-ed71ac4a9ed9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:55.191581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810478f-67ca-419a-900d-ed71ac4a9ed9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:55.215806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 529/1059] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:28:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:28:56.156039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623acaf-bb8a-46f6-9731-4d7af25232f9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:56.156575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623acaf-bb8a-46f6-9731-4d7af25232f9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:56.156575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623acaf-bb8a-46f6-9731-4d7af25232f9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:56.157901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 531/1060] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:56.163230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ec9fa-96af-4f70-a16f-3087ef4c15b1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:56.163518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ec9fa-96af-4f70-a16f-3087ef4c15b1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:56.163797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ec9fa-96af-4f70-a16f-3087ef4c15b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:56.183051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f43ec9fa-96af-4f70-a16f-3087ef4c15b1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:56.184238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f43ec9fa-96af-4f70-a16f-3087ef4c15b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:56.260842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 530/1061] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:56.288959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623acaf-bb8a-46f6-9731-4d7af25232f9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:56.402137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623acaf-bb8a-46f6-9731-4d7af25232f9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:56.437040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f8996-55c8-4264-9214-6640ab3ddfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:56.437893 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f8996-55c8-4264-9214-6640ab3ddfaa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:56.438318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f8996-55c8-4264-9214-6640ab3ddfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:56.438734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f8996-55c8-4264-9214-6640ab3ddfaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:56.448821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f8996-55c8-4264-9214-6640ab3ddfaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-856f8996-55c8-4264-9214-6640ab3ddfaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:56.454398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:56.455527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:28:56.456577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:56.458522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 532/1062] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Aug 4 04:28:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:56.464565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ec9fa-96af-4f70-a16f-3087ef4c15b1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:56.530324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:56.567072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ec9fa-96af-4f70-a16f-3087ef4c15b1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:56.602724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e905357-755d-464d-b705-587dd8f34beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:56.603371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e905357-755d-464d-b705-587dd8f34beb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:56.603650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e905357-755d-464d-b705-587dd8f34beb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:56.603917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e905357-755d-464d-b705-587dd8f34beb None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:56.604631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e905357-755d-464d-b705-587dd8f34beb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:56.604932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e905357-755d-464d-b705-587dd8f34beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:56.606287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e905357-755d-464d-b705-587dd8f34beb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:56.619985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 531/1063] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Aug 4 04:28:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:56.621331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f8996-55c8-4264-9214-6640ab3ddfaa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:56.659259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:56.727714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f8996-55c8-4264-9214-6640ab3ddfaa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:56.767744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c9961-a15e-4377-bbf6-5e9966b83f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:56.768389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c9961-a15e-4377-bbf6-5e9966b83f32 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:56.768664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c9961-a15e-4377-bbf6-5e9966b83f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:56.768930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c9961-a15e-4377-bbf6-5e9966b83f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:56.779460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c9961-a15e-4377-bbf6-5e9966b83f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:56.780993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c9961-a15e-4377-bbf6-5e9966b83f32 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-631c9961-a15e-4377-bbf6-5e9966b83f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:56.795722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:56.796897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:56.798042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:56.798042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:56.798042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:56.798042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:56.799006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 533/1064] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:56.802927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e905357-755d-464d-b705-587dd8f34beb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:56.907238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e905357-755d-464d-b705-587dd8f34beb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:56.937177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:56.944220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164759e9-622a-4b19-b662-b86921d12705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:56.944844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164759e9-622a-4b19-b662-b86921d12705 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:56.945120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164759e9-622a-4b19-b662-b86921d12705 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:56.945391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164759e9-622a-4b19-b662-b86921d12705 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:56.946078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164759e9-622a-4b19-b662-b86921d12705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:56.946377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164759e9-622a-4b19-b662-b86921d12705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:56.947778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164759e9-622a-4b19-b662-b86921d12705 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:56.964970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 532/1065] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:56.966158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c9961-a15e-4377-bbf6-5e9966b83f32 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.055759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:57.072362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c9961-a15e-4377-bbf6-5e9966b83f32 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:57.105991 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21892297-a189-490f-8cdb-656075e0a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:57.106623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21892297-a189-490f-8cdb-656075e0a8cc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.106898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21892297-a189-490f-8cdb-656075e0a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.107194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21892297-a189-490f-8cdb-656075e0a8cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.115892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21892297-a189-490f-8cdb-656075e0a8cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:57.117327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21892297-a189-490f-8cdb-656075e0a8cc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:57.121377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5c67-8ddc-469d-8a34-f72f259fbcc3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.121661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5c67-8ddc-469d-8a34-f72f259fbcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.121923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5c67-8ddc-469d-8a34-f72f259fbcc3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.123479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 533/1066] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:57.128236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36805042-53ab-4a6e-942b-28f681f68986 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.128516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36805042-53ab-4a6e-942b-28f681f68986 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.128785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36805042-53ab-4a6e-942b-28f681f68986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-21892297-a189-490f-8cdb-656075e0a8cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:28:57.129289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:57.130174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:57.131756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 534/1067] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Aug 4 04:28:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:57.136231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21892297-a189-490f-8cdb-656075e0a8cc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.148271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-36805042-53ab-4a6e-942b-28f681f68986 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:57.149463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-36805042-53ab-4a6e-942b-28f681f68986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:57.220117 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 534/1068] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:28:57.241998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21892297-a189-490f-8cdb-656075e0a8cc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:57.242504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36805042-53ab-4a6e-942b-28f681f68986 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.278879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d11ae-61c7-484c-a694-6cecc4933452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:57.279531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d11ae-61c7-484c-a694-6cecc4933452 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.279803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d11ae-61c7-484c-a694-6cecc4933452 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.280066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d11ae-61c7-484c-a694-6cecc4933452 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.281474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d11ae-61c7-484c-a694-6cecc4933452 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:57.281773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d11ae-61c7-484c-a694-6cecc4933452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:57.283219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d11ae-61c7-484c-a694-6cecc4933452 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:57.300415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 535/1069] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:28:57.301781 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355e52d-70ed-4ece-a9ef-e13824ad8a34 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.302066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355e52d-70ed-4ece-a9ef-e13824ad8a34 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.302334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355e52d-70ed-4ece-a9ef-e13824ad8a34 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.303751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 536/1070] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:28:57.305951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355e52d-70ed-4ece-a9ef-e13824ad8a34 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.309749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:57.345143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36805042-53ab-4a6e-942b-28f681f68986 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:57.365172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:57.379454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801c73-c206-41fd-87c2-b1a947170476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:57.380092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801c73-c206-41fd-87c2-b1a947170476 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.380375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801c73-c206-41fd-87c2-b1a947170476 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.380646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801c73-c206-41fd-87c2-b1a947170476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.400486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4801c73-c206-41fd-87c2-b1a947170476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d4801c73-c206-41fd-87c2-b1a947170476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:28:57.406230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:57.407184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:28:57.408336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:57.409173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355e52d-70ed-4ece-a9ef-e13824ad8a34 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:57.409267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 535/1071] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:57.409267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d88be-e30e-47f4-a0d6-25ddb0e1b85b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.409267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d88be-e30e-47f4-a0d6-25ddb0e1b85b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.409534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d88be-e30e-47f4-a0d6-25ddb0e1b85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.427629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d55d88be-e30e-47f4-a0d6-25ddb0e1b85b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:28:57.428820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d55d88be-e30e-47f4-a0d6-25ddb0e1b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:28:57.443461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b744d2e-a424-4074-a10b-bc67d3dcced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:57.444099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b744d2e-a424-4074-a10b-bc67d3dcced0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.444373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b744d2e-a424-4074-a10b-bc67d3dcced0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.444638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b744d2e-a424-4074-a10b-bc67d3dcced0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.454839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b744d2e-a424-4074-a10b-bc67d3dcced0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:57.456385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b744d2e-a424-4074-a10b-bc67d3dcced0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9b744d2e-a424-4074-a10b-bc67d3dcced0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:57.471404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:57.472304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:57.473164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:57.473164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:57.473164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:57.473164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:28:57.473738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 537/1072] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:28:57.474649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b744d2e-a424-4074-a10b-bc67d3dcced0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.494590 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 536/1073] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:28:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:28:57.495447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d88be-e30e-47f4-a0d6-25ddb0e1b85b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.532528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:57.579875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b744d2e-a424-4074-a10b-bc67d3dcced0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:57.595381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d88be-e30e-47f4-a0d6-25ddb0e1b85b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:57.605439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:57.613257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21e30-3d3e-424e-89ae-212239994053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:57.613871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21e30-3d3e-424e-89ae-212239994053 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.614152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21e30-3d3e-424e-89ae-212239994053 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.614423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21e30-3d3e-424e-89ae-212239994053 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.615184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb21e30-3d3e-424e-89ae-212239994053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:57.615496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb21e30-3d3e-424e-89ae-212239994053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:57.616848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb21e30-3d3e-424e-89ae-212239994053 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:57.626448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 538/1074] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:57.627499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21e30-3d3e-424e-89ae-212239994053 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.630160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde926-09ac-4e38-af73-b1498d7a8049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:57.630782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde926-09ac-4e38-af73-b1498d7a8049 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.631092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde926-09ac-4e38-af73-b1498d7a8049 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.631369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dde926-09ac-4e38-af73-b1498d7a8049 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.632131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde926-09ac-4e38-af73-b1498d7a8049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:57.632440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde926-09ac-4e38-af73-b1498d7a8049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:57.633830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dde926-09ac-4e38-af73-b1498d7a8049 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:57.647163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 537/1075] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:57.647985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde926-09ac-4e38-af73-b1498d7a8049 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.736286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21e30-3d3e-424e-89ae-212239994053 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:57.754853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dde926-09ac-4e38-af73-b1498d7a8049 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:57.760486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:57.778858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857cb0-326a-489f-8227-8af54df6cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:57.780495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857cb0-326a-489f-8227-8af54df6cee2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.781398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857cb0-326a-489f-8227-8af54df6cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.781680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857cb0-326a-489f-8227-8af54df6cee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.789190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8b45c-50b8-4898-aedf-e85e9951ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:57.789827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8b45c-50b8-4898-aedf-e85e9951ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.790111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8b45c-50b8-4898-aedf-e85e9951ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.790385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8b45c-50b8-4898-aedf-e85e9951ffe9 None admin] PATH_INFO: `/v3/users/68d0b863feac48e5b46c166789f79e94` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.791588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8b45c-50b8-4898-aedf-e85e9951ffe9 None admin] RBAC: Authorizing `identity:get_user(user_id=68d0b863feac48e5b46c166789f79e94)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:57.793011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8b45c-50b8-4898-aedf-e85e9951ffe9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:57.799745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 538/1076] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/users/68d0b863feac48e5b46c166789f79e94 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:57.799745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8b45c-50b8-4898-aedf-e85e9951ffe9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.841209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:57.853060 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d857cb0-326a-489f-8227-8af54df6cee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:57.854592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d857cb0-326a-489f-8227-8af54df6cee2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:57.901514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8b45c-50b8-4898-aedf-e85e9951ffe9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:57.935439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e96af-1b98-44a0-800f-089e8241eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:57.936076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e96af-1b98-44a0-800f-089e8241eaaa None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:57.936353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e96af-1b98-44a0-800f-089e8241eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:57.936676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e96af-1b98-44a0-800f-089e8241eaaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:57.943412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e96af-1b98-44a0-800f-089e8241eaaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:57.944837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e96af-1b98-44a0-800f-089e8241eaaa None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:57.953526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 539/1077] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:28:57.954361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857cb0-326a-489f-8227-8af54df6cee2 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-bd9e96af-1b98-44a0-800f-089e8241eaaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:28:57.956468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:57.957642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:57.958498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:28:57.958498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:28:57.958498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:28:57.958498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:28:57.958498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:28:57.958498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:28:57.958498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:28:57.958498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:57.958498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 539/1078] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:57.959256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e96af-1b98-44a0-800f-089e8241eaaa None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:57.978916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:58.055169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:58.059898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e96af-1b98-44a0-800f-089e8241eaaa None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:58.060734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857cb0-326a-489f-8227-8af54df6cee2 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:58.094441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3986237-5f1f-457a-9d03-3409e48619d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:58.094625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4605ebe-ed02-43b1-83b9-9dd2fe31dc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:58.095030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605ebe-ed02-43b1-83b9-9dd2fe31dc41 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:58.095175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3986237-5f1f-457a-9d03-3409e48619d1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:58.095307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3986237-5f1f-457a-9d03-3409e48619d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:58.095401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605ebe-ed02-43b1-83b9-9dd2fe31dc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:58.095577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4605ebe-ed02-43b1-83b9-9dd2fe31dc41 None admin] PATH_INFO: `/v3/projects/3a42170f1e564196aac3054ee17f9763` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:58.095683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3986237-5f1f-457a-9d03-3409e48619d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:58.096731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4605ebe-ed02-43b1-83b9-9dd2fe31dc41 None admin] RBAC: Authorizing `identity:get_project(project_id=3a42170f1e564196aac3054ee17f9763)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:58.098152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4605ebe-ed02-43b1-83b9-9dd2fe31dc41 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:58.099853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 540/1079] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/projects/3a42170f1e564196aac3054ee17f9763 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:58.100609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4605ebe-ed02-43b1-83b9-9dd2fe31dc41 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:58.106310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3986237-5f1f-457a-9d03-3409e48619d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:58.107783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3986237-5f1f-457a-9d03-3409e48619d1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d3986237-5f1f-457a-9d03-3409e48619d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:28:58.122463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:28:58.123589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:28:58.124541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:28:58.124541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:28:58.124541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:28:58.124541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:28:58.124541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 540/1080] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:28:58.124541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3986237-5f1f-457a-9d03-3409e48619d1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:58.188183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:58.208049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4605ebe-ed02-43b1-83b9-9dd2fe31dc41 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:58.228657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3986237-5f1f-457a-9d03-3409e48619d1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:58.242572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802ee43-343f-4853-8ef2-ce320db92378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:58.243205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802ee43-343f-4853-8ef2-ce320db92378 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:58.243479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802ee43-343f-4853-8ef2-ce320db92378 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:58.243743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802ee43-343f-4853-8ef2-ce320db92378 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:58.244478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802ee43-343f-4853-8ef2-ce320db92378 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:58.244775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802ee43-343f-4853-8ef2-ce320db92378 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:58.246172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802ee43-343f-4853-8ef2-ce320db92378 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:58.257722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 541/1081] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:58.258499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802ee43-343f-4853-8ef2-ce320db92378 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:58.262458 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d377-0cd8-4283-a573-9f4a6e5c61a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:58.263169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d377-0cd8-4283-a573-9f4a6e5c61a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:58.263451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d377-0cd8-4283-a573-9f4a6e5c61a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:58.263723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d377-0cd8-4283-a573-9f4a6e5c61a0 None admin] PATH_INFO: `/v3/projects/3a42170f1e564196aac3054ee17f9763/users/68d0b863feac48e5b46c166789f79e94/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:58.266218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5d377-0cd8-4283-a573-9f4a6e5c61a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a42170f1e564196aac3054ee17f9763, user_id=68d0b863feac48e5b46c166789f79e94, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:58.267664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5d377-0cd8-4283-a573-9f4a6e5c61a0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:58.280409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 541/1082] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:58 2022] PUT /identity/v3/projects/3a42170f1e564196aac3054ee17f9763/users/68d0b863feac48e5b46c166789f79e94/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:28:58.281172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d377-0cd8-4283-a573-9f4a6e5c61a0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:28:58.294025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:28:58.394698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802ee43-343f-4853-8ef2-ce320db92378 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:58.404742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d377-0cd8-4283-a573-9f4a6e5c61a0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:28:58.446862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28a8ae-6410-434e-b225-aad85799cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:58.447458 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9c2d8-b55b-4e6e-90f0-10bdf8a72f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:28:58.447612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a8ae-6410-434e-b225-aad85799cf21 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:58.447888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a8ae-6410-434e-b225-aad85799cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:58.448155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c2d8-b55b-4e6e-90f0-10bdf8a72f08 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:28:58.448280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a8ae-6410-434e-b225-aad85799cf21 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:58.448356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c2d8-b55b-4e6e-90f0-10bdf8a72f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:28:58.449091 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c2d8-b55b-4e6e-90f0-10bdf8a72f08 None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/bd26e2ac2578438e854d51d8eed26463/roles/b9beb0e1058b4fe0b7c885c46f775cab` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:28:58.449206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28a8ae-6410-434e-b225-aad85799cf21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:28:58.449206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28a8ae-6410-434e-b225-aad85799cf21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:58.450485 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28a8ae-6410-434e-b225-aad85799cf21 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:58.450891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9c2d8-b55b-4e6e-90f0-10bdf8a72f08 None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=bd26e2ac2578438e854d51d8eed26463, role_id=b9beb0e1058b4fe0b7c885c46f775cab)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:28:58.452891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9c2d8-b55b-4e6e-90f0-10bdf8a72f08 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:28:58.465133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 542/1083] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:28:58.469225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 542/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:28:58 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/bd26e2ac2578438e854d51d8eed26463/roles/b9beb0e1058b4fe0b7c885c46f775cab => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:29:00.281517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baed48-d755-4200-8eb8-6b5d6761e598 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:00.282065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baed48-d755-4200-8eb8-6b5d6761e598 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:00.282065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baed48-d755-4200-8eb8-6b5d6761e598 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:00.283454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 543/1085] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:00.288802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99476521-44eb-441b-8dd2-ab4cb9735a9f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:00.289202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99476521-44eb-441b-8dd2-ab4cb9735a9f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:00.289344 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99476521-44eb-441b-8dd2-ab4cb9735a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:00.308205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-99476521-44eb-441b-8dd2-ab4cb9735a9f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:00.309380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-99476521-44eb-441b-8dd2-ab4cb9735a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:00.370269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:00.379849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 543/1086] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:00.401904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baed48-d755-4200-8eb8-6b5d6761e598 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:00.411591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:00.507293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baed48-d755-4200-8eb8-6b5d6761e598 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:00.520384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62bbf-6358-488a-9540-d9b38a213a07 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:00.520670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62bbf-6358-488a-9540-d9b38a213a07 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:00.520944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62bbf-6358-488a-9540-d9b38a213a07 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:00.522293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 544/1087] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:29:00.527148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aed29-9f3e-4569-99e3-70f5713e77ac None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:00.527430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aed29-9f3e-4569-99e3-70f5713e77ac None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:00.527712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aed29-9f3e-4569-99e3-70f5713e77ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:00.542429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a271aa-6e4c-449f-9f05-9b076525fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:00.543003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a271aa-6e4c-449f-9f05-9b076525fe6a None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:00.543300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a271aa-6e4c-449f-9f05-9b076525fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:00.543572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a271aa-6e4c-449f-9f05-9b076525fe6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:00.545269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1e3aed29-9f3e-4569-99e3-70f5713e77ac None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:00.546446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e3aed29-9f3e-4569-99e3-70f5713e77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:00.554919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a271aa-6e4c-449f-9f05-9b076525fe6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-52a271aa-6e4c-449f-9f05-9b076525fe6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:29:00.559849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:00.560815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:00.562169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:29:00.563127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 544/1088] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:00.567508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a271aa-6e4c-449f-9f05-9b076525fe6a None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:00.612835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 545/1089] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:00.631908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:00.636775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3aed29-9f3e-4569-99e3-70f5713e77ac None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:00.667368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a271aa-6e4c-449f-9f05-9b076525fe6a None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:00.700946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c63bb-98b7-4d97-bac5-2099bcb64999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:00.701557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c63bb-98b7-4d97-bac5-2099bcb64999 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:00.701835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c63bb-98b7-4d97-bac5-2099bcb64999 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:00.702665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c63bb-98b7-4d97-bac5-2099bcb64999 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:00.703414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c63bb-98b7-4d97-bac5-2099bcb64999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:00.703715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c63bb-98b7-4d97-bac5-2099bcb64999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:00.705083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c63bb-98b7-4d97-bac5-2099bcb64999 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:00.713566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 545/1090] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:29:00.719320 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c63bb-98b7-4d97-bac5-2099bcb64999 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:00.734797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3aed29-9f3e-4569-99e3-70f5713e77ac None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:00.763742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:00.770810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a19fc5-d743-4e8c-a070-aabc9f4144d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:00.772054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19fc5-d743-4e8c-a070-aabc9f4144d4 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:00.772054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19fc5-d743-4e8c-a070-aabc9f4144d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:00.772054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19fc5-d743-4e8c-a070-aabc9f4144d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:00.782820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a19fc5-d743-4e8c-a070-aabc9f4144d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-92a19fc5-d743-4e8c-a070-aabc9f4144d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:29:00.787879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:00.788956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:29:00.789832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 546/1091] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Aug 4 04:29:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:29:00.795209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a19fc5-d743-4e8c-a070-aabc9f4144d4 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:00.824710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c63bb-98b7-4d97-bac5-2099bcb64999 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:00.851436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:00.859898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec26705-74c7-4469-a1d7-707dc498aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:00.860525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec26705-74c7-4469-a1d7-707dc498aa05 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:00.860800 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec26705-74c7-4469-a1d7-707dc498aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:00.861071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec26705-74c7-4469-a1d7-707dc498aa05 None admin] PATH_INFO: `/v3/users/68d0b863feac48e5b46c166789f79e94` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:00.862221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec26705-74c7-4469-a1d7-707dc498aa05 None admin] RBAC: Authorizing `identity:get_user(user_id=68d0b863feac48e5b46c166789f79e94)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:00.863689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec26705-74c7-4469-a1d7-707dc498aa05 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:00.865539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 546/1092] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:00 2022] GET /identity/v3/users/68d0b863feac48e5b46c166789f79e94 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:29:00.870885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec26705-74c7-4469-a1d7-707dc498aa05 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:00.896228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a19fc5-d743-4e8c-a070-aabc9f4144d4 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:00.930639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e84464-5226-4e5c-8199-ced6af7de0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:00.931282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e84464-5226-4e5c-8199-ced6af7de0fe None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:00.931557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e84464-5226-4e5c-8199-ced6af7de0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:00.931823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e84464-5226-4e5c-8199-ced6af7de0fe None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:00.932525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e84464-5226-4e5c-8199-ced6af7de0fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:00.932818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e84464-5226-4e5c-8199-ced6af7de0fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:00.934164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e84464-5226-4e5c-8199-ced6af7de0fe None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:00.942055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 547/1093] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Aug 4 04:29:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:29:00.947734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e84464-5226-4e5c-8199-ced6af7de0fe None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:00.974375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec26705-74c7-4469-a1d7-707dc498aa05 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:00.999718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:01.008665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee5dd1-ced9-458e-9eea-ddfdcabe6903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:01.009281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5dd1-ced9-458e-9eea-ddfdcabe6903 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:01.009559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5dd1-ced9-458e-9eea-ddfdcabe6903 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:01.009829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5dd1-ced9-458e-9eea-ddfdcabe6903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:01.049002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e84464-5226-4e5c-8199-ced6af7de0fe None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:01.074067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:01.081597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee5dd1-ced9-458e-9eea-ddfdcabe6903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:01.083070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee5dd1-ced9-458e-9eea-ddfdcabe6903 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:01.086633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171703-0f24-4bcc-9e90-9728ee5562c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:01.087298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171703-0f24-4bcc-9e90-9728ee5562c1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:01.087580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171703-0f24-4bcc-9e90-9728ee5562c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:01.087853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171703-0f24-4bcc-9e90-9728ee5562c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:01.098908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9171703-0f24-4bcc-9e90-9728ee5562c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:01.100359 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9171703-0f24-4bcc-9e90-9728ee5562c1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-b9171703-0f24-4bcc-9e90-9728ee5562c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:29:01.114225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:01.115133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:01.116004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:29:01.116004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:29:01.116004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:29:01.116004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:29:01.116004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 548/1094] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:29:01.121075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171703-0f24-4bcc-9e90-9728ee5562c1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:01.182419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 547/1095] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:29:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 04:29:01.188172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee5dd1-ced9-458e-9eea-ddfdcabe6903 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:01.220135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171703-0f24-4bcc-9e90-9728ee5562c1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:01.222439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:01.255357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6bb9-3621-4028-9c76-89cefae20835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:01.256100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6bb9-3621-4028-9c76-89cefae20835 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:01.256374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6bb9-3621-4028-9c76-89cefae20835 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:01.256667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6bb9-3621-4028-9c76-89cefae20835 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:01.257339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c6bb9-3621-4028-9c76-89cefae20835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:01.257640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c6bb9-3621-4028-9c76-89cefae20835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:01.259000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c6bb9-3621-4028-9c76-89cefae20835 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:01.270595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 549/1096] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:29:01.276173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6bb9-3621-4028-9c76-89cefae20835 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:01.279040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:01.285771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee5dd1-ced9-458e-9eea-ddfdcabe6903 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:01.319846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41effd97-750e-4f92-a63d-e19dd8bfa7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:01.320400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41effd97-750e-4f92-a63d-e19dd8bfa7de None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:01.320683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41effd97-750e-4f92-a63d-e19dd8bfa7de None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:01.320948 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41effd97-750e-4f92-a63d-e19dd8bfa7de None admin] PATH_INFO: `/v3/projects/3a42170f1e564196aac3054ee17f9763` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:01.322087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41effd97-750e-4f92-a63d-e19dd8bfa7de None admin] RBAC: Authorizing `identity:get_project(project_id=3a42170f1e564196aac3054ee17f9763)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:01.323544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41effd97-750e-4f92-a63d-e19dd8bfa7de None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:01.325209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 548/1097] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:01 2022] GET /identity/v3/projects/3a42170f1e564196aac3054ee17f9763 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:29:01.331462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41effd97-750e-4f92-a63d-e19dd8bfa7de None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:01.380835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6bb9-3621-4028-9c76-89cefae20835 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:01.415287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f9959-7acc-4298-86bd-01eae6994a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:01.415941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9959-7acc-4298-86bd-01eae6994a89 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:01.416212 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9959-7acc-4298-86bd-01eae6994a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:01.416476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9959-7acc-4298-86bd-01eae6994a89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:01.423699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f9959-7acc-4298-86bd-01eae6994a89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:01.425113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f9959-7acc-4298-86bd-01eae6994a89 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:01.431426 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41effd97-750e-4f92-a63d-e19dd8bfa7de None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-837f9959-7acc-4298-86bd-01eae6994a89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:29:01.437006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:01.438270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:29:01.439227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 550/1098] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Aug 4 04:29:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:29:01.443856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f9959-7acc-4298-86bd-01eae6994a89 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:01.466109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8378e-65da-48ef-b739-5eaf1f00baed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:01.466721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8378e-65da-48ef-b739-5eaf1f00baed None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:01.467031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8378e-65da-48ef-b739-5eaf1f00baed None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:01.467309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8378e-65da-48ef-b739-5eaf1f00baed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:01.468603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8378e-65da-48ef-b739-5eaf1f00baed None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=3a42170f1e564196aac3054ee17f9763, user.id=68d0b863feac48e5b46c166789f79e94) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:01.468906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8378e-65da-48ef-b739-5eaf1f00baed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:01.469320 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:01.470317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8378e-65da-48ef-b739-5eaf1f00baed None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:01.476547 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 549/1099] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:29:01 2022] GET /identity/v3/role_assignments?user.id=68d0b863feac48e5b46c166789f79e94&scope.project.id=3a42170f1e564196aac3054ee17f9763&role.id=c1429555635349208e8b2bd908436746 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:29:01.551393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f9959-7acc-4298-86bd-01eae6994a89 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:01.586385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042194-596a-44f1-bce8-b0f7dd418774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:01.586930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042194-596a-44f1-bce8-b0f7dd418774 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:01.587251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042194-596a-44f1-bce8-b0f7dd418774 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:01.587528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042194-596a-44f1-bce8-b0f7dd418774 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:01.588348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94042194-596a-44f1-bce8-b0f7dd418774 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:01.588658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94042194-596a-44f1-bce8-b0f7dd418774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:01.590119 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94042194-596a-44f1-bce8-b0f7dd418774 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:01.610128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 551/1100] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Aug 4 04:29:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:29:01.616001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8378e-65da-48ef-b739-5eaf1f00baed None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:01.647555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:01.721670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8378e-65da-48ef-b739-5eaf1f00baed None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:01.757850 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1158c8-9358-4753-a75c-22ca514c9020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:01.758309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1158c8-9358-4753-a75c-22ca514c9020 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:01.758589 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1158c8-9358-4753-a75c-22ca514c9020 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:01.758861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1158c8-9358-4753-a75c-22ca514c9020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:01.825871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1158c8-9358-4753-a75c-22ca514c9020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:01.827908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1158c8-9358-4753-a75c-22ca514c9020 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:01.854547 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:01.925798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 550/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:29:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 04:29:01.931666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042194-596a-44f1-bce8-b0f7dd418774 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:02.013083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:02.031943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042194-596a-44f1-bce8-b0f7dd418774 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:02.065163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edb697-ea9d-4f9f-a974-51a9a56bafd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:02.065796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edb697-ea9d-4f9f-a974-51a9a56bafd6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:02.066074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edb697-ea9d-4f9f-a974-51a9a56bafd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:02.066345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edb697-ea9d-4f9f-a974-51a9a56bafd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:02.076009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edb697-ea9d-4f9f-a974-51a9a56bafd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:02.078021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edb697-ea9d-4f9f-a974-51a9a56bafd6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d4edb697-ea9d-4f9f-a974-51a9a56bafd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:29:02.092314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:02.093219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:02.094094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:29:02.094094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:29:02.094094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:29:02.094094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:29:02.094094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 552/1102] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:02.099159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1158c8-9358-4753-a75c-22ca514c9020 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:02.196545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1158c8-9358-4753-a75c-22ca514c9020 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:02.222753 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:02.231287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac2d1b-2462-4efe-a2b5-7cafd6eac272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:02.231906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac2d1b-2462-4efe-a2b5-7cafd6eac272 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:02.232182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac2d1b-2462-4efe-a2b5-7cafd6eac272 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:02.232452 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac2d1b-2462-4efe-a2b5-7cafd6eac272 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:02.233169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac2d1b-2462-4efe-a2b5-7cafd6eac272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:02.234144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac2d1b-2462-4efe-a2b5-7cafd6eac272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:02.235496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac2d1b-2462-4efe-a2b5-7cafd6eac272 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:02.246839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 551/1103] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:29:02.252500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edb697-ea9d-4f9f-a974-51a9a56bafd6 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:02.350544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edb697-ea9d-4f9f-a974-51a9a56bafd6 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:02.383009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d69e-b258-4a2c-bda4-1e63e0468596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:02.383693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d69e-b258-4a2c-bda4-1e63e0468596 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:02.383886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d69e-b258-4a2c-bda4-1e63e0468596 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:02.384146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530d69e-b258-4a2c-bda4-1e63e0468596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:02.386009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:02.392554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530d69e-b258-4a2c-bda4-1e63e0468596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:02.393984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530d69e-b258-4a2c-bda4-1e63e0468596 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-a530d69e-b258-4a2c-bda4-1e63e0468596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:29:02.406396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:02.407321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:02.408213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:29:02.408213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:29:02.408213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:29:02.408213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:29:02.408213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:29:02.408213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:29:02.408213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:29:02.408213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:29:02.408213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 553/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:02.413487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac2d1b-2462-4efe-a2b5-7cafd6eac272 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:02.510167 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac2d1b-2462-4efe-a2b5-7cafd6eac272 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:02.543972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09cba7-52ce-4385-a531-48233f3340f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:02.544591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09cba7-52ce-4385-a531-48233f3340f3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:02.544905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09cba7-52ce-4385-a531-48233f3340f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:02.545174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09cba7-52ce-4385-a531-48233f3340f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:02.545916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09cba7-52ce-4385-a531-48233f3340f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:02.546219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09cba7-52ce-4385-a531-48233f3340f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:02.547947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09cba7-52ce-4385-a531-48233f3340f3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:02.559885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 552/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:02.565860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d69e-b258-4a2c-bda4-1e63e0468596 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:02.674717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530d69e-b258-4a2c-bda4-1e63e0468596 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:02.707136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52061d-5014-40a4-a68d-ca160c754c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:02.707643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52061d-5014-40a4-a68d-ca160c754c0a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:02.707916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52061d-5014-40a4-a68d-ca160c754c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:02.708182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52061d-5014-40a4-a68d-ca160c754c0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:02.708952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52061d-5014-40a4-a68d-ca160c754c0a None admin] RBAC: Adding query filter params (role.id=b9beb0e1058b4fe0b7c885c46f775cab, scope.project.id=642faef2d1654874bd7205420512998a, user.id=bd26e2ac2578438e854d51d8eed26463) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:02.709253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52061d-5014-40a4-a68d-ca160c754c0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:02.710660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52061d-5014-40a4-a68d-ca160c754c0a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:02.716507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 554/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:29:02 2022] GET /identity/v3/role_assignments?user.id=bd26e2ac2578438e854d51d8eed26463&scope.project.id=642faef2d1654874bd7205420512998a&role.id=b9beb0e1058b4fe0b7c885c46f775cab => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:03.523878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602354c1-4ff4-40dd-a27f-bca9769244a4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:03.524390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602354c1-4ff4-40dd-a27f-bca9769244a4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:03.524504 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602354c1-4ff4-40dd-a27f-bca9769244a4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:03.525759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 553/1107] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:03.531598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206dd12-d8b6-48c1-b13e-c9f487601336 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:03.532022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206dd12-d8b6-48c1-b13e-c9f487601336 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:03.532134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206dd12-d8b6-48c1-b13e-c9f487601336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:03.550635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5206dd12-d8b6-48c1-b13e-c9f487601336 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:03.551825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5206dd12-d8b6-48c1-b13e-c9f487601336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:03.602197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:03.616448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 555/1108] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:03.640484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602354c1-4ff4-40dd-a27f-bca9769244a4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:03.691989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:03.742448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602354c1-4ff4-40dd-a27f-bca9769244a4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:03.776054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bc450-9713-4c83-b5bc-921c3402db2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:03.776626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bc450-9713-4c83-b5bc-921c3402db2e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:03.776905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bc450-9713-4c83-b5bc-921c3402db2e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:03.777176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bc450-9713-4c83-b5bc-921c3402db2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:03.778310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bc450-9713-4c83-b5bc-921c3402db2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:03.779777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bc450-9713-4c83-b5bc-921c3402db2e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:03.781966 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 554/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:29:03.787732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206dd12-d8b6-48c1-b13e-c9f487601336 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:03.884298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206dd12-d8b6-48c1-b13e-c9f487601336 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:03.917772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bc2b3-2b61-4930-9d37-009508b5f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:03.918381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc2b3-2b61-4930-9d37-009508b5f4ae None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:03.918712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc2b3-2b61-4930-9d37-009508b5f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:03.918995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc2b3-2b61-4930-9d37-009508b5f4ae None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:03.919674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bc2b3-2b61-4930-9d37-009508b5f4ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:03.921105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bc2b3-2b61-4930-9d37-009508b5f4ae None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:03.941755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 556/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:29:03 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:29:05.962718 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f2556-a4b8-4bf9-972d-d310b1176b1c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:05.964515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f2556-a4b8-4bf9-972d-d310b1176b1c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:05.964515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f2556-a4b8-4bf9-972d-d310b1176b1c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:05.964766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 555/1111] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:05.970019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f4f9-802d-437c-bcc0-4e701ac9077f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:05.970491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f4f9-802d-437c-bcc0-4e701ac9077f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:05.970604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f4f9-802d-437c-bcc0-4e701ac9077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:05.987979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4c21f4f9-802d-437c-bcc0-4e701ac9077f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:05.989142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4c21f4f9-802d-437c-bcc0-4e701ac9077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:06.027620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:06.056074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 557/1112] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:06.078565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f2556-a4b8-4bf9-972d-d310b1176b1c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:06.177403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f2556-a4b8-4bf9-972d-d310b1176b1c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:06.193169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:06.210923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94b024-a105-4651-8932-7a907beb33f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:06.211579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b024-a105-4651-8932-7a907beb33f4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:06.211860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b024-a105-4651-8932-7a907beb33f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:06.212132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b024-a105-4651-8932-7a907beb33f4 None admin] PATH_INFO: `/v3/roles/22759f25d96f4063a7d10f7048d7b3bd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:06.213557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94b024-a105-4651-8932-7a907beb33f4 None admin] RBAC: Authorizing `identity:get_role(role_id=22759f25d96f4063a7d10f7048d7b3bd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:06.214908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94b024-a105-4651-8932-7a907beb33f4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:06.216258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 556/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:06 2022] GET /identity/v3/roles/22759f25d96f4063a7d10f7048d7b3bd => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:06.222617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f4f9-802d-437c-bcc0-4e701ac9077f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:06.317856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f4f9-802d-437c-bcc0-4e701ac9077f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:06.351575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610384d7-f6df-402a-9d66-f2419e4efc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:06.352194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610384d7-f6df-402a-9d66-f2419e4efc95 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:06.352467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610384d7-f6df-402a-9d66-f2419e4efc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:06.352735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610384d7-f6df-402a-9d66-f2419e4efc95 None admin] PATH_INFO: `/v3/users/e1b7ed87274849b6a43c42f70e4d474e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:06.365353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610384d7-f6df-402a-9d66-f2419e4efc95 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b7ed87274849b6a43c42f70e4d474e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:06.366767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610384d7-f6df-402a-9d66-f2419e4efc95 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:06.368369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 558/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:06 2022] GET /identity/v3/users/e1b7ed87274849b6a43c42f70e4d474e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:06.374354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94b024-a105-4651-8932-7a907beb33f4 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:06.477825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94b024-a105-4651-8932-7a907beb33f4 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:06.510921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f46395-4041-4fc9-afb0-44e4e57c1ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:06.511555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f46395-4041-4fc9-afb0-44e4e57c1ecf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:06.511837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f46395-4041-4fc9-afb0-44e4e57c1ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:06.512111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f46395-4041-4fc9-afb0-44e4e57c1ecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:06.563710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:06.580150 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f46395-4041-4fc9-afb0-44e4e57c1ecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:06.581519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f46395-4041-4fc9-afb0-44e4e57c1ecf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:06.676878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 557/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:29:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:29:06.682875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610384d7-f6df-402a-9d66-f2419e4efc95 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:06.712621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:06.779839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610384d7-f6df-402a-9d66-f2419e4efc95 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:06.813170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e84a14-3b85-42f1-8ea1-bffdf2d5a0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:06.813791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e84a14-3b85-42f1-8ea1-bffdf2d5a0ab None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:06.814063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e84a14-3b85-42f1-8ea1-bffdf2d5a0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:06.814326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e84a14-3b85-42f1-8ea1-bffdf2d5a0ab None admin] PATH_INFO: `/v3/projects/3a42170f1e564196aac3054ee17f9763` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:06.815463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e84a14-3b85-42f1-8ea1-bffdf2d5a0ab None admin] RBAC: Authorizing `identity:get_project(project_id=3a42170f1e564196aac3054ee17f9763)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:06.816874 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e84a14-3b85-42f1-8ea1-bffdf2d5a0ab None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:06.818506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 559/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:06 2022] GET /identity/v3/projects/3a42170f1e564196aac3054ee17f9763 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:06.824663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f46395-4041-4fc9-afb0-44e4e57c1ecf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:06.906344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:06.923066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f46395-4041-4fc9-afb0-44e4e57c1ecf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:06.956955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4c8af-f079-4a47-9e32-cf10bdc5cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:06.957564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4c8af-f079-4a47-9e32-cf10bdc5cde1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:06.957842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4c8af-f079-4a47-9e32-cf10bdc5cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:06.958114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4c8af-f079-4a47-9e32-cf10bdc5cde1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:06.958892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4c8af-f079-4a47-9e32-cf10bdc5cde1 None admin] RBAC: Adding query filter params (role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=3a42170f1e564196aac3054ee17f9763, user.id=e1b7ed87274849b6a43c42f70e4d474e) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:06.959253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4c8af-f079-4a47-9e32-cf10bdc5cde1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:06.960709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4c8af-f079-4a47-9e32-cf10bdc5cde1 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:06.966037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 558/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:29:06 2022] GET /identity/v3/role_assignments?user.id=e1b7ed87274849b6a43c42f70e4d474e&scope.project.id=3a42170f1e564196aac3054ee17f9763&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:08.954686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9036d-caeb-4b1a-8aec-b26044908e3d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:08.955261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9036d-caeb-4b1a-8aec-b26044908e3d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:08.955261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9036d-caeb-4b1a-8aec-b26044908e3d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:08.956607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 560/1118] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:08.961654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92397fe-7279-4c3e-90bd-f5609b5654f7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:08.962085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92397fe-7279-4c3e-90bd-f5609b5654f7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:08.962194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92397fe-7279-4c3e-90bd-f5609b5654f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:08.980188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c92397fe-7279-4c3e-90bd-f5609b5654f7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:08.981365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c92397fe-7279-4c3e-90bd-f5609b5654f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:09.060972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 559/1119] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:09.083357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9036d-caeb-4b1a-8aec-b26044908e3d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:09.177277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:09.181396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9036d-caeb-4b1a-8aec-b26044908e3d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:09.213990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc599711-f0d2-4132-a5ef-a8d5fb8f2824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:09.214609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc599711-f0d2-4132-a5ef-a8d5fb8f2824 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:09.214891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc599711-f0d2-4132-a5ef-a8d5fb8f2824 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:09.215189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc599711-f0d2-4132-a5ef-a8d5fb8f2824 None admin] PATH_INFO: `/v3/roles/22759f25d96f4063a7d10f7048d7b3bd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:09.216588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc599711-f0d2-4132-a5ef-a8d5fb8f2824 None admin] RBAC: Authorizing `identity:get_role(role_id=22759f25d96f4063a7d10f7048d7b3bd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:09.218529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc599711-f0d2-4132-a5ef-a8d5fb8f2824 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:09.219874 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 561/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:09 2022] GET /identity/v3/roles/22759f25d96f4063a7d10f7048d7b3bd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:09.225695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92397fe-7279-4c3e-90bd-f5609b5654f7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:09.300653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:09.321481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92397fe-7279-4c3e-90bd-f5609b5654f7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:09.354802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828217-b28a-427e-97b5-2a179a39f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:09.355463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828217-b28a-427e-97b5-2a179a39f5fa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:09.355740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828217-b28a-427e-97b5-2a179a39f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:09.356010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828217-b28a-427e-97b5-2a179a39f5fa None admin] PATH_INFO: `/v3/users/e1b7ed87274849b6a43c42f70e4d474e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:09.357138 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828217-b28a-427e-97b5-2a179a39f5fa None admin] RBAC: Authorizing `identity:get_user(user_id=e1b7ed87274849b6a43c42f70e4d474e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:09.359324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828217-b28a-427e-97b5-2a179a39f5fa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:09.360977 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 560/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:09 2022] GET /identity/v3/users/e1b7ed87274849b6a43c42f70e4d474e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:09.366704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc599711-f0d2-4132-a5ef-a8d5fb8f2824 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:09.467445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc599711-f0d2-4132-a5ef-a8d5fb8f2824 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:09.501197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b2635-2af6-44de-95d4-fa5ed85cd499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:09.501815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b2635-2af6-44de-95d4-fa5ed85cd499 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:09.502090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b2635-2af6-44de-95d4-fa5ed85cd499 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:09.502362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b2635-2af6-44de-95d4-fa5ed85cd499 None admin] PATH_INFO: `/v3/projects/3a42170f1e564196aac3054ee17f9763` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:09.503507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b2635-2af6-44de-95d4-fa5ed85cd499 None admin] RBAC: Authorizing `identity:get_project(project_id=3a42170f1e564196aac3054ee17f9763)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:09.504910 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b2635-2af6-44de-95d4-fa5ed85cd499 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:09.506536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 562/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:09 2022] GET /identity/v3/projects/3a42170f1e564196aac3054ee17f9763 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:09.512561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828217-b28a-427e-97b5-2a179a39f5fa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:09.610077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828217-b28a-427e-97b5-2a179a39f5fa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:09.642284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bc2e5-5259-44f6-885a-4c26543c386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:09.642939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bc2e5-5259-44f6-885a-4c26543c386b None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:09.643252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bc2e5-5259-44f6-885a-4c26543c386b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:09.643528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bc2e5-5259-44f6-885a-4c26543c386b None admin] PATH_INFO: `/v3/projects/3a42170f1e564196aac3054ee17f9763/users/e1b7ed87274849b6a43c42f70e4d474e/roles/22759f25d96f4063a7d10f7048d7b3bd` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:09.645675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bc2e5-5259-44f6-885a-4c26543c386b None admin] RBAC: Authorizing `identity:create_grant(project_id=3a42170f1e564196aac3054ee17f9763, user_id=e1b7ed87274849b6a43c42f70e4d474e, role_id=22759f25d96f4063a7d10f7048d7b3bd)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:09.647125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bc2e5-5259-44f6-885a-4c26543c386b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:09.659983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 561/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:29:09 2022] PUT /identity/v3/projects/3a42170f1e564196aac3054ee17f9763/users/e1b7ed87274849b6a43c42f70e4d474e/roles/22759f25d96f4063a7d10f7048d7b3bd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:29:11.647742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b395ac-57e5-499c-a17f-905b2ae181a0 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:11.648273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b395ac-57e5-499c-a17f-905b2ae181a0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:11.648273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b395ac-57e5-499c-a17f-905b2ae181a0 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:11.649622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 563/1124] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:11.654857 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50251f9-555a-492d-9a8b-796b5155ce5c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:11.655393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50251f9-555a-492d-9a8b-796b5155ce5c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:11.655493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50251f9-555a-492d-9a8b-796b5155ce5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:11.667952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:11.674767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c50251f9-555a-492d-9a8b-796b5155ce5c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:11.676172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c50251f9-555a-492d-9a8b-796b5155ce5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:11.741508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 562/1125] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:29:11.765329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b395ac-57e5-499c-a17f-905b2ae181a0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:11.808035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:11.873030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b395ac-57e5-499c-a17f-905b2ae181a0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:11.906342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bf26f-879f-423e-987c-fa892dd8e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:11.906898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bf26f-879f-423e-987c-fa892dd8e12c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:11.907197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bf26f-879f-423e-987c-fa892dd8e12c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:11.907465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bf26f-879f-423e-987c-fa892dd8e12c None admin] PATH_INFO: `/v3/roles/22759f25d96f4063a7d10f7048d7b3bd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:11.908869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bf26f-879f-423e-987c-fa892dd8e12c None admin] RBAC: Authorizing `identity:get_role(role_id=22759f25d96f4063a7d10f7048d7b3bd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:11.910213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bf26f-879f-423e-987c-fa892dd8e12c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:11.911580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 564/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:11 2022] GET /identity/v3/roles/22759f25d96f4063a7d10f7048d7b3bd => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:11.917473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50251f9-555a-492d-9a8b-796b5155ce5c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:12.016684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50251f9-555a-492d-9a8b-796b5155ce5c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:12.049391 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ec31-75cc-4887-a567-94e1b70b0ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:12.050022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ec31-75cc-4887-a567-94e1b70b0ebf None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:12.050301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ec31-75cc-4887-a567-94e1b70b0ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:12.050574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ec31-75cc-4887-a567-94e1b70b0ebf None admin] PATH_INFO: `/v3/users/e1b7ed87274849b6a43c42f70e4d474e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:12.051864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ec31-75cc-4887-a567-94e1b70b0ebf None admin] RBAC: Authorizing `identity:get_user(user_id=e1b7ed87274849b6a43c42f70e4d474e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:12.053281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ec31-75cc-4887-a567-94e1b70b0ebf None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:12.054869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 563/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:11 2022] GET /identity/v3/users/e1b7ed87274849b6a43c42f70e4d474e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:12.060698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bf26f-879f-423e-987c-fa892dd8e12c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:12.159909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bf26f-879f-423e-987c-fa892dd8e12c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:12.162078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:12.193958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93adb4-9e6e-4834-8751-2a013be6fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:12.194558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93adb4-9e6e-4834-8751-2a013be6fef0 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:12.194833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93adb4-9e6e-4834-8751-2a013be6fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:12.195136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93adb4-9e6e-4834-8751-2a013be6fef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:12.260504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93adb4-9e6e-4834-8751-2a013be6fef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:12.261949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93adb4-9e6e-4834-8751-2a013be6fef0 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:12.356903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 565/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:29:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:29:12.363394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ec31-75cc-4887-a567-94e1b70b0ebf None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:12.367090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:12.460894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ec31-75cc-4887-a567-94e1b70b0ebf None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:12.493826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1e8f0-3876-490e-acb5-688d46b09191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:12.494462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e8f0-3876-490e-acb5-688d46b09191 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:12.494742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e8f0-3876-490e-acb5-688d46b09191 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:12.495038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e8f0-3876-490e-acb5-688d46b09191 None admin] PATH_INFO: `/v3/projects/3a42170f1e564196aac3054ee17f9763` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:12.496176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1e8f0-3876-490e-acb5-688d46b09191 None admin] RBAC: Authorizing `identity:get_project(project_id=3a42170f1e564196aac3054ee17f9763)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:12.497584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1e8f0-3876-490e-acb5-688d46b09191 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:12.499371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 564/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:12 2022] GET /identity/v3/projects/3a42170f1e564196aac3054ee17f9763 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:12.509583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93adb4-9e6e-4834-8751-2a013be6fef0 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:12.512678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:12.605464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93adb4-9e6e-4834-8751-2a013be6fef0 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:12.638632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40158677-a45b-4fd1-a09b-589e7215a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:12.639268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40158677-a45b-4fd1-a09b-589e7215a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:12.639544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40158677-a45b-4fd1-a09b-589e7215a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:12.639811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40158677-a45b-4fd1-a09b-589e7215a3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:12.640664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40158677-a45b-4fd1-a09b-589e7215a3d9 None admin] RBAC: Adding query filter params (role.id=22759f25d96f4063a7d10f7048d7b3bd, scope.project.id=3a42170f1e564196aac3054ee17f9763, user.id=e1b7ed87274849b6a43c42f70e4d474e) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:12.640964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40158677-a45b-4fd1-a09b-589e7215a3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:12.642371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40158677-a45b-4fd1-a09b-589e7215a3d9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:12.647987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 566/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:29:12 2022] GET /identity/v3/role_assignments?user.id=e1b7ed87274849b6a43c42f70e4d474e&scope.project.id=3a42170f1e564196aac3054ee17f9763&role.id=22759f25d96f4063a7d10f7048d7b3bd => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:14.656027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508335-636f-49c9-9154-3590f263e2c0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:14.656587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508335-636f-49c9-9154-3590f263e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:14.656587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80508335-636f-49c9-9154-3590f263e2c0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:14.657900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 565/1131] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:14.663684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0cc6d-56e2-4a93-847d-6847cb4ad2e6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:14.664080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0cc6d-56e2-4a93-847d-6847cb4ad2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:14.664236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0cc6d-56e2-4a93-847d-6847cb4ad2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:14.682357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3dc0cc6d-56e2-4a93-847d-6847cb4ad2e6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:14.683571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3dc0cc6d-56e2-4a93-847d-6847cb4ad2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:14.743555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:14.750317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 567/1132] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:14.774405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508335-636f-49c9-9154-3590f263e2c0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:14.850189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:14.882395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80508335-636f-49c9-9154-3590f263e2c0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:14.916581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57af51-1850-4d87-a1cb-72006326fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:14.917149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57af51-1850-4d87-a1cb-72006326fda6 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:14.917427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57af51-1850-4d87-a1cb-72006326fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:14.917699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57af51-1850-4d87-a1cb-72006326fda6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:14.918830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57af51-1850-4d87-a1cb-72006326fda6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:14.920442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57af51-1850-4d87-a1cb-72006326fda6 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:14.922041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 566/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:29:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:14.928400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0cc6d-56e2-4a93-847d-6847cb4ad2e6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:15.024658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0cc6d-56e2-4a93-847d-6847cb4ad2e6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:15.057352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9bed3-aaf4-4f60-b410-49a418fe5e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:15.057958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9bed3-aaf4-4f60-b410-49a418fe5e46 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:15.058238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9bed3-aaf4-4f60-b410-49a418fe5e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:15.058510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9bed3-aaf4-4f60-b410-49a418fe5e46 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:15.059214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9bed3-aaf4-4f60-b410-49a418fe5e46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:15.060628 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9bed3-aaf4-4f60-b410-49a418fe5e46 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:15.088741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 568/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:29:14 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:29:17.138211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0b4bc-083a-476c-9a7e-f29916894fb0 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:17.138722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0b4bc-083a-476c-9a7e-f29916894fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:17.138722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0b4bc-083a-476c-9a7e-f29916894fb0 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:17.140164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 567/1135] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:17.145537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74a958-cbac-428a-b0ae-47fe5aa78017 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:17.145961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74a958-cbac-428a-b0ae-47fe5aa78017 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:17.146098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74a958-cbac-428a-b0ae-47fe5aa78017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:17.164446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6f74a958-cbac-428a-b0ae-47fe5aa78017 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:17.165636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6f74a958-cbac-428a-b0ae-47fe5aa78017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:17.210292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:17.232402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 569/1136] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:17.257207 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0b4bc-083a-476c-9a7e-f29916894fb0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:17.355410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0b4bc-083a-476c-9a7e-f29916894fb0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:17.388310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f16c4e-5d46-4669-bcfa-e75f9130fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:17.389378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f16c4e-5d46-4669-bcfa-e75f9130fc32 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:17.389662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f16c4e-5d46-4669-bcfa-e75f9130fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:17.389932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f16c4e-5d46-4669-bcfa-e75f9130fc32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:17.391103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f16c4e-5d46-4669-bcfa-e75f9130fc32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:17.392515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f16c4e-5d46-4669-bcfa-e75f9130fc32 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:17.394076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 568/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:29:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:17.399864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74a958-cbac-428a-b0ae-47fe5aa78017 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:17.498128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74a958-cbac-428a-b0ae-47fe5aa78017 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:17.532171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b023ba-efa0-45ba-b818-ba2ff5385d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:17.532784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b023ba-efa0-45ba-b818-ba2ff5385d27 None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:17.533060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b023ba-efa0-45ba-b818-ba2ff5385d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:17.533331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b023ba-efa0-45ba-b818-ba2ff5385d27 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:17.534003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b023ba-efa0-45ba-b818-ba2ff5385d27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:17.535459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b023ba-efa0-45ba-b818-ba2ff5385d27 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:17.557029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 570/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:29:17 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:29:19.571046 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a570989-bc08-4efc-b956-ca909e30c5fa None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:19.571597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a570989-bc08-4efc-b956-ca909e30c5fa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:19.571597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a570989-bc08-4efc-b956-ca909e30c5fa None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:19.573043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 569/1139] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:19.579233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56545c25-ba6a-4715-8849-ea760c14dc86 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:19.579668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56545c25-ba6a-4715-8849-ea760c14dc86 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:19.579920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56545c25-ba6a-4715-8849-ea760c14dc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:19.599156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-56545c25-ba6a-4715-8849-ea760c14dc86 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:19.600399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-56545c25-ba6a-4715-8849-ea760c14dc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:19.629660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:19.668791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 571/1140] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:19.692967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a570989-bc08-4efc-b956-ca909e30c5fa None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:19.703597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:19.791744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a570989-bc08-4efc-b956-ca909e30c5fa None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:19.825191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68b231-9434-46ff-adb7-b90804f66c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:19.825761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68b231-9434-46ff-adb7-b90804f66c23 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:19.826039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68b231-9434-46ff-adb7-b90804f66c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:19.826307 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68b231-9434-46ff-adb7-b90804f66c23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:19.836232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68b231-9434-46ff-adb7-b90804f66c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-6e68b231-9434-46ff-adb7-b90804f66c23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:29:19.841085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:19.842271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:29:19.843508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 570/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:19.848435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56545c25-ba6a-4715-8849-ea760c14dc86 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:19.945265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56545c25-ba6a-4715-8849-ea760c14dc86 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:19.980432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521e91d-fbec-48ce-9999-e2f4f6157562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:19.981037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521e91d-fbec-48ce-9999-e2f4f6157562 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:19.981315 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521e91d-fbec-48ce-9999-e2f4f6157562 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:19.981586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521e91d-fbec-48ce-9999-e2f4f6157562 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:19.982297 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521e91d-fbec-48ce-9999-e2f4f6157562 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:19.982598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521e91d-fbec-48ce-9999-e2f4f6157562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:19.984097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521e91d-fbec-48ce-9999-e2f4f6157562 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:19.992435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 572/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:19.998808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68b231-9434-46ff-adb7-b90804f66c23 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:20.064437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:20.096643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68b231-9434-46ff-adb7-b90804f66c23 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:20.129652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5b21-7fb2-4246-865e-01b195c2f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:20.130274 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5b21-7fb2-4246-865e-01b195c2f421 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:20.130554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5b21-7fb2-4246-865e-01b195c2f421 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:20.130823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5b21-7fb2-4246-865e-01b195c2f421 None admin] PATH_INFO: `/v3/users/06b0e4f6cc024914b8b51f5f84684e00` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:20.148089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e5b21-7fb2-4246-865e-01b195c2f421 None admin] RBAC: Authorizing `identity:get_user(user_id=06b0e4f6cc024914b8b51f5f84684e00)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:20.149661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e5b21-7fb2-4246-865e-01b195c2f421 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:20.151495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 571/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:19 2022] GET /identity/v3/users/06b0e4f6cc024914b8b51f5f84684e00 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:20.157876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521e91d-fbec-48ce-9999-e2f4f6157562 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:20.186618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:20.256573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521e91d-fbec-48ce-9999-e2f4f6157562 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:20.288648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0d916-beb5-4e9d-8d27-ff2cc2b12352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:20.289246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0d916-beb5-4e9d-8d27-ff2cc2b12352 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:20.289521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0d916-beb5-4e9d-8d27-ff2cc2b12352 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:20.289789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0d916-beb5-4e9d-8d27-ff2cc2b12352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:20.353800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0d916-beb5-4e9d-8d27-ff2cc2b12352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:20.355180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0d916-beb5-4e9d-8d27-ff2cc2b12352 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:20.380618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:20.456598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 573/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:29:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:29:20.462513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5b21-7fb2-4246-865e-01b195c2f421 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:20.558318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5b21-7fb2-4246-865e-01b195c2f421 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:20.583237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:20.592096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce5bf4-20e5-44f6-89fb-57fe0cf1d95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:20.592729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce5bf4-20e5-44f6-89fb-57fe0cf1d95e None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:20.593008 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce5bf4-20e5-44f6-89fb-57fe0cf1d95e None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:20.593284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce5bf4-20e5-44f6-89fb-57fe0cf1d95e None admin] PATH_INFO: `/v3/projects/8a2dd2999ca94112a3a5fcdfea837950` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:20.594513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce5bf4-20e5-44f6-89fb-57fe0cf1d95e None admin] RBAC: Authorizing `identity:get_project(project_id=8a2dd2999ca94112a3a5fcdfea837950)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:20.595965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce5bf4-20e5-44f6-89fb-57fe0cf1d95e None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:20.597614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 572/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:20 2022] GET /identity/v3/projects/8a2dd2999ca94112a3a5fcdfea837950 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:20.603681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0d916-beb5-4e9d-8d27-ff2cc2b12352 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:20.699514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0d916-beb5-4e9d-8d27-ff2cc2b12352 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:20.724207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:20.732267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434285fa-6812-4ce9-b01d-d1343f25283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:20.733401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434285fa-6812-4ce9-b01d-d1343f25283f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:20.733677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434285fa-6812-4ce9-b01d-d1343f25283f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:20.733938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434285fa-6812-4ce9-b01d-d1343f25283f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:20.734719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434285fa-6812-4ce9-b01d-d1343f25283f None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=8a2dd2999ca94112a3a5fcdfea837950, user.id=06b0e4f6cc024914b8b51f5f84684e00) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:20.735047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434285fa-6812-4ce9-b01d-d1343f25283f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:20.736451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434285fa-6812-4ce9-b01d-d1343f25283f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:20.741876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 574/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:29:20 2022] GET /identity/v3/role_assignments?user.id=06b0e4f6cc024914b8b51f5f84684e00&scope.project.id=8a2dd2999ca94112a3a5fcdfea837950&role.id=c1429555635349208e8b2bd908436746 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:22.702159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150209e-e53a-47c3-b9a2-e4634f504c0e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:22.702762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150209e-e53a-47c3-b9a2-e4634f504c0e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:22.702762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150209e-e53a-47c3-b9a2-e4634f504c0e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:22.704183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 573/1147] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:22.709417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfbde-d53d-4b4d-9fc3-a14f58836ef4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:22.709846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfbde-d53d-4b4d-9fc3-a14f58836ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:22.709957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfbde-d53d-4b4d-9fc3-a14f58836ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:22.728846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-520cfbde-d53d-4b4d-9fc3-a14f58836ef4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:22.730002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-520cfbde-d53d-4b4d-9fc3-a14f58836ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:22.794814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 575/1148] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:22.821158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150209e-e53a-47c3-b9a2-e4634f504c0e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:22.920983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150209e-e53a-47c3-b9a2-e4634f504c0e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:22.954445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66076700-ea25-4189-9ead-b1c78c969d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:22.955033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66076700-ea25-4189-9ead-b1c78c969d90 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:22.955309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66076700-ea25-4189-9ead-b1c78c969d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:22.955582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66076700-ea25-4189-9ead-b1c78c969d90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:22.965256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66076700-ea25-4189-9ead-b1c78c969d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-66076700-ea25-4189-9ead-b1c78c969d90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:29:22.970742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:22.971907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:29:22.972829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 574/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:29:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:22.978006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cfbde-d53d-4b4d-9fc3-a14f58836ef4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:23.075740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cfbde-d53d-4b4d-9fc3-a14f58836ef4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:23.098051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:23.110192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502498a0-9482-4c27-85a8-935a1a70cc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:23.110795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502498a0-9482-4c27-85a8-935a1a70cc70 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:23.111126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502498a0-9482-4c27-85a8-935a1a70cc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:23.111381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502498a0-9482-4c27-85a8-935a1a70cc70 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:23.112093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502498a0-9482-4c27-85a8-935a1a70cc70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:23.112395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502498a0-9482-4c27-85a8-935a1a70cc70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:23.113761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502498a0-9482-4c27-85a8-935a1a70cc70 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:23.121755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 576/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:23.128157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66076700-ea25-4189-9ead-b1c78c969d90 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:23.192462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:23.239237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66076700-ea25-4189-9ead-b1c78c969d90 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:23.274272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c021-370e-4888-a095-7a8aa7d24836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:23.274919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c021-370e-4888-a095-7a8aa7d24836 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:23.275250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c021-370e-4888-a095-7a8aa7d24836 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:23.275527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c021-370e-4888-a095-7a8aa7d24836 None admin] PATH_INFO: `/v3/users/06b0e4f6cc024914b8b51f5f84684e00` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:23.276748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152c021-370e-4888-a095-7a8aa7d24836 None admin] RBAC: Authorizing `identity:get_user(user_id=06b0e4f6cc024914b8b51f5f84684e00)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:23.278251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152c021-370e-4888-a095-7a8aa7d24836 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:23.280605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 575/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:23 2022] GET /identity/v3/users/06b0e4f6cc024914b8b51f5f84684e00 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:23.286402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502498a0-9482-4c27-85a8-935a1a70cc70 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:23.384043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502498a0-9482-4c27-85a8-935a1a70cc70 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:23.416825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557254a7-715c-47a8-9268-6a9b5ca5f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:23.417452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557254a7-715c-47a8-9268-6a9b5ca5f567 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:23.417729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557254a7-715c-47a8-9268-6a9b5ca5f567 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:23.418000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557254a7-715c-47a8-9268-6a9b5ca5f567 None admin] PATH_INFO: `/v3/projects/8a2dd2999ca94112a3a5fcdfea837950` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:23.419159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557254a7-715c-47a8-9268-6a9b5ca5f567 None admin] RBAC: Authorizing `identity:get_project(project_id=8a2dd2999ca94112a3a5fcdfea837950)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:23.420597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557254a7-715c-47a8-9268-6a9b5ca5f567 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:23.422239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 577/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:23 2022] GET /identity/v3/projects/8a2dd2999ca94112a3a5fcdfea837950 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:23.428757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c021-370e-4888-a095-7a8aa7d24836 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:23.528899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c021-370e-4888-a095-7a8aa7d24836 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:23.550498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:23.562513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93028e-9c63-4bee-ac05-0c1076a27366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:23.563210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93028e-9c63-4bee-ac05-0c1076a27366 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:23.563501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93028e-9c63-4bee-ac05-0c1076a27366 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:23.563765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93028e-9c63-4bee-ac05-0c1076a27366 None admin] PATH_INFO: `/v3/projects/8a2dd2999ca94112a3a5fcdfea837950/users/06b0e4f6cc024914b8b51f5f84684e00/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:23.565676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93028e-9c63-4bee-ac05-0c1076a27366 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a2dd2999ca94112a3a5fcdfea837950, user_id=06b0e4f6cc024914b8b51f5f84684e00, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:23.567122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93028e-9c63-4bee-ac05-0c1076a27366 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:23.580335 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 576/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:29:23 2022] PUT /identity/v3/projects/8a2dd2999ca94112a3a5fcdfea837950/users/06b0e4f6cc024914b8b51f5f84684e00/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:29:25.569267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae015d-31ea-4200-b8ae-8f12f4b58f98 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:25.569821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae015d-31ea-4200-b8ae-8f12f4b58f98 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:25.569821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae015d-31ea-4200-b8ae-8f12f4b58f98 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:25.571190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 578/1154] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:25.576403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2bb9-7267-4c43-b9ae-fbbb3b606ede None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:25.576805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2bb9-7267-4c43-b9ae-fbbb3b606ede None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:25.576952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2bb9-7267-4c43-b9ae-fbbb3b606ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:25.595144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ca8c2bb9-7267-4c43-b9ae-fbbb3b606ede None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:25.596344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ca8c2bb9-7267-4c43-b9ae-fbbb3b606ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:25.661656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 577/1155] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:25.685031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae015d-31ea-4200-b8ae-8f12f4b58f98 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:25.737699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:25.785633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae015d-31ea-4200-b8ae-8f12f4b58f98 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:25.819365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359472-88eb-4bc8-8bcd-f2efb3dd130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:25.819929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359472-88eb-4bc8-8bcd-f2efb3dd130b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:25.820208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359472-88eb-4bc8-8bcd-f2efb3dd130b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:25.820480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359472-88eb-4bc8-8bcd-f2efb3dd130b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:25.830728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24359472-88eb-4bc8-8bcd-f2efb3dd130b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-24359472-88eb-4bc8-8bcd-f2efb3dd130b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:29:25.835637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:25.836694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:29:25.837750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 579/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:25.842836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2bb9-7267-4c43-b9ae-fbbb3b606ede None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:25.947083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2bb9-7267-4c43-b9ae-fbbb3b606ede None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:25.959620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:25.980670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f3dc9-ce9e-4f48-8739-aaa0defd3037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:25.981280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f3dc9-ce9e-4f48-8739-aaa0defd3037 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:25.981557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f3dc9-ce9e-4f48-8739-aaa0defd3037 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:25.981825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f3dc9-ce9e-4f48-8739-aaa0defd3037 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:25.983097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f3dc9-ce9e-4f48-8739-aaa0defd3037 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:25.983399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f3dc9-ce9e-4f48-8739-aaa0defd3037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:25.984749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f3dc9-ce9e-4f48-8739-aaa0defd3037 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:25.992499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 578/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:25.998951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359472-88eb-4bc8-8bcd-f2efb3dd130b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:26.098286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359472-88eb-4bc8-8bcd-f2efb3dd130b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:26.111149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:26.132317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7ea87-0198-4ce2-8cc1-4e084fc93c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:26.133006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7ea87-0198-4ce2-8cc1-4e084fc93c42 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:26.133286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7ea87-0198-4ce2-8cc1-4e084fc93c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:26.133558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7ea87-0198-4ce2-8cc1-4e084fc93c42 None admin] PATH_INFO: `/v3/users/06b0e4f6cc024914b8b51f5f84684e00` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:26.134701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7ea87-0198-4ce2-8cc1-4e084fc93c42 None admin] RBAC: Authorizing `identity:get_user(user_id=06b0e4f6cc024914b8b51f5f84684e00)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:26.136155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7ea87-0198-4ce2-8cc1-4e084fc93c42 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:26.137765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 580/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:25 2022] GET /identity/v3/users/06b0e4f6cc024914b8b51f5f84684e00 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:26.143666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f3dc9-ce9e-4f48-8739-aaa0defd3037 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:26.247512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f3dc9-ce9e-4f48-8739-aaa0defd3037 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:26.281662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385fc6-8dd9-4c84-adcb-a1f419604f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:26.282270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385fc6-8dd9-4c84-adcb-a1f419604f81 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:26.282548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385fc6-8dd9-4c84-adcb-a1f419604f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:26.282820 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c385fc6-8dd9-4c84-adcb-a1f419604f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:26.323804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:26.349495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c385fc6-8dd9-4c84-adcb-a1f419604f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:26.351121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c385fc6-8dd9-4c84-adcb-a1f419604f81 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:26.455063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 579/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:29:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:29:26.461045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7ea87-0198-4ce2-8cc1-4e084fc93c42 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:26.558557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7ea87-0198-4ce2-8cc1-4e084fc93c42 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:26.590616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a8d01-bf83-4188-b5ad-4de2ec53adc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:26.591266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a8d01-bf83-4188-b5ad-4de2ec53adc6 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:26.591541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a8d01-bf83-4188-b5ad-4de2ec53adc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:26.592366 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a8d01-bf83-4188-b5ad-4de2ec53adc6 None admin] PATH_INFO: `/v3/projects/8a2dd2999ca94112a3a5fcdfea837950` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:26.593505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a8d01-bf83-4188-b5ad-4de2ec53adc6 None admin] RBAC: Authorizing `identity:get_project(project_id=8a2dd2999ca94112a3a5fcdfea837950)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:26.594921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a8d01-bf83-4188-b5ad-4de2ec53adc6 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:26.596574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 581/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:26 2022] GET /identity/v3/projects/8a2dd2999ca94112a3a5fcdfea837950 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:26.602815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385fc6-8dd9-4c84-adcb-a1f419604f81 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:26.680403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:26.706046 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c385fc6-8dd9-4c84-adcb-a1f419604f81 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:26.740637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736fb01-ecc1-4283-86aa-c255684c59a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:26.741245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736fb01-ecc1-4283-86aa-c255684c59a2 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:26.741523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736fb01-ecc1-4283-86aa-c255684c59a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:26.741792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736fb01-ecc1-4283-86aa-c255684c59a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:26.742572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736fb01-ecc1-4283-86aa-c255684c59a2 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=8a2dd2999ca94112a3a5fcdfea837950, user.id=06b0e4f6cc024914b8b51f5f84684e00) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:26.742898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736fb01-ecc1-4283-86aa-c255684c59a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:26.744455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736fb01-ecc1-4283-86aa-c255684c59a2 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:26.750934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 580/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:29:26 2022] GET /identity/v3/role_assignments?user.id=06b0e4f6cc024914b8b51f5f84684e00&scope.project.id=8a2dd2999ca94112a3a5fcdfea837950&role.id=c1429555635349208e8b2bd908436746 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:28.789603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711fdb1-d927-4bfa-b735-a1aba005392c None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:28.790031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711fdb1-d927-4bfa-b735-a1aba005392c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:28.790144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711fdb1-d927-4bfa-b735-a1aba005392c None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:28.791515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 582/1162] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:28.797428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3da48-464c-454e-8079-39685520ac0f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:28.798083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3da48-464c-454e-8079-39685520ac0f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:28.798225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3da48-464c-454e-8079-39685520ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:28.816561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-03e3da48-464c-454e-8079-39685520ac0f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:28.817729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-03e3da48-464c-454e-8079-39685520ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:28.883049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 581/1163] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:28.906198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711fdb1-d927-4bfa-b735-a1aba005392c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:28.956043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:29.006891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711fdb1-d927-4bfa-b735-a1aba005392c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:29.039391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a61ff7-640a-4583-adfa-85dd51b7581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:29.039929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a61ff7-640a-4583-adfa-85dd51b7581a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:29.040208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a61ff7-640a-4583-adfa-85dd51b7581a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:29.040480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a61ff7-640a-4583-adfa-85dd51b7581a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:29.105277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a61ff7-640a-4583-adfa-85dd51b7581a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:29.106708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a61ff7-640a-4583-adfa-85dd51b7581a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:29.152158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:29.202947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 583/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:29:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:29:29.208974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3da48-464c-454e-8079-39685520ac0f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:29.272780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:29.306944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3da48-464c-454e-8079-39685520ac0f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:29.339841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3343d45-162f-4915-80b5-28887380a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:29.340467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343d45-162f-4915-80b5-28887380a9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:29.340746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343d45-162f-4915-80b5-28887380a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:29.341020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343d45-162f-4915-80b5-28887380a9f0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:29.348158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3343d45-162f-4915-80b5-28887380a9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:29.349584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3343d45-162f-4915-80b5-28887380a9f0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d3343d45-162f-4915-80b5-28887380a9f0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:29.361444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:29.362719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:29:29.363994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 582/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:29:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:29.368600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a61ff7-640a-4583-adfa-85dd51b7581a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:29.465826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a61ff7-640a-4583-adfa-85dd51b7581a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:29.499182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bc1c1-4bbc-4a8f-8f83-d230aa13a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:29.499788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bc1c1-4bbc-4a8f-8f83-d230aa13a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:29.500068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bc1c1-4bbc-4a8f-8f83-d230aa13a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:29.500344 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bc1c1-4bbc-4a8f-8f83-d230aa13a1a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:29.501024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bc1c1-4bbc-4a8f-8f83-d230aa13a1a5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:29.501327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bc1c1-4bbc-4a8f-8f83-d230aa13a1a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:29.502678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bc1c1-4bbc-4a8f-8f83-d230aa13a1a5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:29.509735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 584/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Aug 4 04:29:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:31.595256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b97e4-3493-44a5-970c-5088590f4802 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:31.595785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b97e4-3493-44a5-970c-5088590f4802 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:31.595785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b97e4-3493-44a5-970c-5088590f4802 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:31.597145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 583/1167] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:31.602444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02932c2b-bdfb-4151-aae3-a817d2077d05 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:31.602814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02932c2b-bdfb-4151-aae3-a817d2077d05 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:31.603070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02932c2b-bdfb-4151-aae3-a817d2077d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:31.621232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-02932c2b-bdfb-4151-aae3-a817d2077d05 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:31.622410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-02932c2b-bdfb-4151-aae3-a817d2077d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:31.629914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:31.689216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 585/1168] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:31.710965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b97e4-3493-44a5-970c-5088590f4802 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:31.809029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b97e4-3493-44a5-970c-5088590f4802 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:31.834415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:31.842630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793226a-a9c3-4b55-a1f1-d5ddad1943d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:31.843262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793226a-a9c3-4b55-a1f1-d5ddad1943d5 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:31.843541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793226a-a9c3-4b55-a1f1-d5ddad1943d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:31.843835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793226a-a9c3-4b55-a1f1-d5ddad1943d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:31.844546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793226a-a9c3-4b55-a1f1-d5ddad1943d5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:31.845940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793226a-a9c3-4b55-a1f1-d5ddad1943d5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:31.862456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 584/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Thu Aug 4 04:29:31 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:29:33.853933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ca5de-94ab-42a0-9fd7-7d6e24e4a7ee None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:33.854468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ca5de-94ab-42a0-9fd7-7d6e24e4a7ee None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:33.854468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ca5de-94ab-42a0-9fd7-7d6e24e4a7ee None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:33.855868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 586/1170] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:33.861373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150600b-5f01-4dee-8294-dd168e781f1b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:33.861812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150600b-5f01-4dee-8294-dd168e781f1b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:33.861932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150600b-5f01-4dee-8294-dd168e781f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:33.880297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e150600b-5f01-4dee-8294-dd168e781f1b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:33.881457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e150600b-5f01-4dee-8294-dd168e781f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:33.949391 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 585/1171] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:33.972181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ca5de-94ab-42a0-9fd7-7d6e24e4a7ee None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:34.072102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ca5de-94ab-42a0-9fd7-7d6e24e4a7ee None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:34.105617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a93f3-3b19-4037-b0b2-0187e1cbcb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:34.106240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a93f3-3b19-4037-b0b2-0187e1cbcb20 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:34.106518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a93f3-3b19-4037-b0b2-0187e1cbcb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:34.106790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a93f3-3b19-4037-b0b2-0187e1cbcb20 None admin] PATH_INFO: `/v3/domains/85fa9d2c52224413ad07c0ba9eed06d1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:34.117452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a93f3-3b19-4037-b0b2-0187e1cbcb20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=85fa9d2c52224413ad07c0ba9eed06d1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:34.118875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a93f3-3b19-4037-b0b2-0187e1cbcb20 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:34.120489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 587/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Aug 4 04:29:33 2022] GET /identity/v3/domains/85fa9d2c52224413ad07c0ba9eed06d1 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:34.127134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150600b-5f01-4dee-8294-dd168e781f1b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:34.221281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150600b-5f01-4dee-8294-dd168e781f1b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:34.238115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:34.255527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f4485-5dec-4052-926c-3d116f853fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:34.256143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f4485-5dec-4052-926c-3d116f853fc4 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:34.256421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f4485-5dec-4052-926c-3d116f853fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:34.256690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f4485-5dec-4052-926c-3d116f853fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:34.257357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f4485-5dec-4052-926c-3d116f853fc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:34.258770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f4485-5dec-4052-926c-3d116f853fc4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:34.284353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 586/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:29:34 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:29:36.304290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eeec6-056d-40f2-a14a-0fefc7f119f5 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:36.304851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eeec6-056d-40f2-a14a-0fefc7f119f5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:36.304851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eeec6-056d-40f2-a14a-0fefc7f119f5 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:36.306193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 588/1174] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:36.312006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee9eac-e8ad-49a2-90f1-ff4bc3448ec2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:36.312399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee9eac-e8ad-49a2-90f1-ff4bc3448ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:36.312609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee9eac-e8ad-49a2-90f1-ff4bc3448ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:36.330995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e1ee9eac-e8ad-49a2-90f1-ff4bc3448ec2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:36.332289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e1ee9eac-e8ad-49a2-90f1-ff4bc3448ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:36.397210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 587/1175] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:36.421532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eeec6-056d-40f2-a14a-0fefc7f119f5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:36.424646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:36.521277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eeec6-056d-40f2-a14a-0fefc7f119f5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:36.554489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df46889-c87d-493a-9652-8e3cfbbee477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:36.555079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46889-c87d-493a-9652-8e3cfbbee477 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:36.555351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46889-c87d-493a-9652-8e3cfbbee477 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:36.555620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46889-c87d-493a-9652-8e3cfbbee477 None admin] PATH_INFO: `/v3/domains/85fa9d2c52224413ad07c0ba9eed06d1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:36.556752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df46889-c87d-493a-9652-8e3cfbbee477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=85fa9d2c52224413ad07c0ba9eed06d1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:36.558170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df46889-c87d-493a-9652-8e3cfbbee477 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:36.559768 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 589/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Aug 4 04:29:36 2022] GET /identity/v3/domains/85fa9d2c52224413ad07c0ba9eed06d1 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:36.566218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee9eac-e8ad-49a2-90f1-ff4bc3448ec2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:36.660334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:36.663699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee9eac-e8ad-49a2-90f1-ff4bc3448ec2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:36.699970 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b475447-09cd-402d-9805-bc2f748df83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:36.700573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475447-09cd-402d-9805-bc2f748df83a None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:36.700854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475447-09cd-402d-9805-bc2f748df83a None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:36.701128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b475447-09cd-402d-9805-bc2f748df83a None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:36.701811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b475447-09cd-402d-9805-bc2f748df83a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:36.703247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b475447-09cd-402d-9805-bc2f748df83a None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:36.724253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 588/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:29:36 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:29:38.788484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f614-6c05-4cc1-8000-998e4e329698 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:38.788984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f614-6c05-4cc1-8000-998e4e329698 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:38.789080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f614-6c05-4cc1-8000-998e4e329698 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:38.790368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 590/1178] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:38.795583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e18971-17a6-4668-8066-3a040bfec43d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:38.795988 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e18971-17a6-4668-8066-3a040bfec43d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:38.796134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e18971-17a6-4668-8066-3a040bfec43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:38.814562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-90e18971-17a6-4668-8066-3a040bfec43d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:38.815771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-90e18971-17a6-4668-8066-3a040bfec43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:38.881286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 589/1179] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:38.904699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9f614-6c05-4cc1-8000-998e4e329698 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:38.978595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:39.010866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9f614-6c05-4cc1-8000-998e4e329698 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:39.043267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71069921-e402-4d5e-beb6-c7db24634de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:39.043884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71069921-e402-4d5e-beb6-c7db24634de9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:39.044158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71069921-e402-4d5e-beb6-c7db24634de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:39.044448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71069921-e402-4d5e-beb6-c7db24634de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:39.054888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71069921-e402-4d5e-beb6-c7db24634de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-71069921-e402-4d5e-beb6-c7db24634de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:29:39.059723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:39.061502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:29:39.062557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 591/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:29:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:39.067616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e18971-17a6-4668-8066-3a040bfec43d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:39.150621 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:39.167531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e18971-17a6-4668-8066-3a040bfec43d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:39.206557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358651-2feb-403b-b74b-b21a048b64fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:39.207196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358651-2feb-403b-b74b-b21a048b64fa None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:39.207472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358651-2feb-403b-b74b-b21a048b64fa None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:39.207735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358651-2feb-403b-b74b-b21a048b64fa None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:39.208432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358651-2feb-403b-b74b-b21a048b64fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:39.208729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358651-2feb-403b-b74b-b21a048b64fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:39.210065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358651-2feb-403b-b74b-b21a048b64fa None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:39.217825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 590/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:29:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:39.223601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71069921-e402-4d5e-beb6-c7db24634de9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:39.319283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71069921-e402-4d5e-beb6-c7db24634de9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:39.346175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:39.352155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20339d37-a157-4e6d-a7e9-450f3964651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:39.352778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339d37-a157-4e6d-a7e9-450f3964651b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:39.353053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339d37-a157-4e6d-a7e9-450f3964651b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:39.353321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339d37-a157-4e6d-a7e9-450f3964651b None admin] PATH_INFO: `/v3/users/2c9cae8d13744368b34ffe79eec49c02` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:39.366584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20339d37-a157-4e6d-a7e9-450f3964651b None admin] RBAC: Authorizing `identity:get_user(user_id=2c9cae8d13744368b34ffe79eec49c02)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:39.368032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20339d37-a157-4e6d-a7e9-450f3964651b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:39.369619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 592/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:39 2022] GET /identity/v3/users/2c9cae8d13744368b34ffe79eec49c02 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:39.376063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358651-2feb-403b-b74b-b21a048b64fa None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:39.474799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358651-2feb-403b-b74b-b21a048b64fa None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:39.508175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f0170-b926-41e7-b6fa-7059eb573198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:39.508782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f0170-b926-41e7-b6fa-7059eb573198 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:39.509059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f0170-b926-41e7-b6fa-7059eb573198 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:39.509325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f0170-b926-41e7-b6fa-7059eb573198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:39.526236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:39.574959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f0170-b926-41e7-b6fa-7059eb573198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:39.576397 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f0170-b926-41e7-b6fa-7059eb573198 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:39.671483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 591/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:29:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 04:29:39.678093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20339d37-a157-4e6d-a7e9-450f3964651b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:39.779416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20339d37-a157-4e6d-a7e9-450f3964651b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:39.813346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012230a-6d68-4b89-a6ef-5119ac26abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:39.813966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012230a-6d68-4b89-a6ef-5119ac26abf2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:39.814246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012230a-6d68-4b89-a6ef-5119ac26abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:39.814520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012230a-6d68-4b89-a6ef-5119ac26abf2 None admin] PATH_INFO: `/v3/projects/d1adf8dbab494cb886acf31847e2cc47` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:39.815673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012230a-6d68-4b89-a6ef-5119ac26abf2 None admin] RBAC: Authorizing `identity:get_project(project_id=d1adf8dbab494cb886acf31847e2cc47)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:39.817097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012230a-6d68-4b89-a6ef-5119ac26abf2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:39.818745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 593/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:39 2022] GET /identity/v3/projects/d1adf8dbab494cb886acf31847e2cc47 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:39.824938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f0170-b926-41e7-b6fa-7059eb573198 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:39.872508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:39.923970 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f0170-b926-41e7-b6fa-7059eb573198 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:39.956405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb880-6b30-475b-a01f-4e810dde71a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:39.957001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb880-6b30-475b-a01f-4e810dde71a4 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:39.957275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb880-6b30-475b-a01f-4e810dde71a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:39.957542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb880-6b30-475b-a01f-4e810dde71a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:39.958309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eb880-6b30-475b-a01f-4e810dde71a4 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=d1adf8dbab494cb886acf31847e2cc47, user.id=2c9cae8d13744368b34ffe79eec49c02) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:39.958610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eb880-6b30-475b-a01f-4e810dde71a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:39.960037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eb880-6b30-475b-a01f-4e810dde71a4 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:39.965283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 592/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:29:39 2022] GET /identity/v3/role_assignments?user.id=2c9cae8d13744368b34ffe79eec49c02&scope.project.id=d1adf8dbab494cb886acf31847e2cc47&role.id=c1429555635349208e8b2bd908436746 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:41.947722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016d49f-da09-4731-95ad-89bce160859b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:41.948325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016d49f-da09-4731-95ad-89bce160859b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:41.948325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016d49f-da09-4731-95ad-89bce160859b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:41.949595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 594/1186] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:41.955454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96d665-a4db-496d-a743-29bc49e04cc1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:41.955869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96d665-a4db-496d-a743-29bc49e04cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:41.956003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96d665-a4db-496d-a743-29bc49e04cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:41.973516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bc96d665-a4db-496d-a743-29bc49e04cc1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:41.974695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bc96d665-a4db-496d-a743-29bc49e04cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:42.038688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 593/1187] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:42.060753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016d49f-da09-4731-95ad-89bce160859b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:42.115339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:42.159240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016d49f-da09-4731-95ad-89bce160859b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:42.195002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f95e67-a454-40e8-b639-aaa34758d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:42.195640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f95e67-a454-40e8-b639-aaa34758d290 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:42.195914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f95e67-a454-40e8-b639-aaa34758d290 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:42.196181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f95e67-a454-40e8-b639-aaa34758d290 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:42.205959 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f95e67-a454-40e8-b639-aaa34758d290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-28f95e67-a454-40e8-b639-aaa34758d290 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:29:42.211130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:42.212250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:29:42.213138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 595/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:42.218299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96d665-a4db-496d-a743-29bc49e04cc1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:42.260225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:42.316954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96d665-a4db-496d-a743-29bc49e04cc1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:42.349092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad98c-f21c-4ca7-a3b2-d582469ec656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:42.349695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad98c-f21c-4ca7-a3b2-d582469ec656 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:42.349974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad98c-f21c-4ca7-a3b2-d582469ec656 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:42.350244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad98c-f21c-4ca7-a3b2-d582469ec656 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:42.350947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad98c-f21c-4ca7-a3b2-d582469ec656 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:42.351276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad98c-f21c-4ca7-a3b2-d582469ec656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:42.352626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad98c-f21c-4ca7-a3b2-d582469ec656 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:42.361127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 594/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:42.367913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f95e67-a454-40e8-b639-aaa34758d290 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:42.466045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f95e67-a454-40e8-b639-aaa34758d290 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:42.482203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:42.500238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a117779-e022-4ee3-a6ec-019125bbc8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:42.500862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a117779-e022-4ee3-a6ec-019125bbc8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:42.501138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a117779-e022-4ee3-a6ec-019125bbc8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:42.501404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a117779-e022-4ee3-a6ec-019125bbc8c9 None admin] PATH_INFO: `/v3/users/2c9cae8d13744368b34ffe79eec49c02` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:42.502546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a117779-e022-4ee3-a6ec-019125bbc8c9 None admin] RBAC: Authorizing `identity:get_user(user_id=2c9cae8d13744368b34ffe79eec49c02)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:42.503978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a117779-e022-4ee3-a6ec-019125bbc8c9 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:42.505541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 596/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:42 2022] GET /identity/v3/users/2c9cae8d13744368b34ffe79eec49c02 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:42.511240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad98c-f21c-4ca7-a3b2-d582469ec656 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:42.611293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad98c-f21c-4ca7-a3b2-d582469ec656 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:42.614044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:42.644151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba977b-8de8-41c8-909a-0e63e7250568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:42.644808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba977b-8de8-41c8-909a-0e63e7250568 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:42.645081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba977b-8de8-41c8-909a-0e63e7250568 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:42.645345 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba977b-8de8-41c8-909a-0e63e7250568 None admin] PATH_INFO: `/v3/projects/d1adf8dbab494cb886acf31847e2cc47` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:42.646468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba977b-8de8-41c8-909a-0e63e7250568 None admin] RBAC: Authorizing `identity:get_project(project_id=d1adf8dbab494cb886acf31847e2cc47)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:42.647894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba977b-8de8-41c8-909a-0e63e7250568 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:42.649537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 595/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:42 2022] GET /identity/v3/projects/d1adf8dbab494cb886acf31847e2cc47 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:42.656085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a117779-e022-4ee3-a6ec-019125bbc8c9 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:42.756022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a117779-e022-4ee3-a6ec-019125bbc8c9 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:42.789390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098c8fb-fb4a-4571-ad9b-9514ff27d361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:42.790055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098c8fb-fb4a-4571-ad9b-9514ff27d361 None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:42.790331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098c8fb-fb4a-4571-ad9b-9514ff27d361 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:42.790600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098c8fb-fb4a-4571-ad9b-9514ff27d361 None admin] PATH_INFO: `/v3/projects/d1adf8dbab494cb886acf31847e2cc47/users/2c9cae8d13744368b34ffe79eec49c02/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:42.792525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098c8fb-fb4a-4571-ad9b-9514ff27d361 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1adf8dbab494cb886acf31847e2cc47, user_id=2c9cae8d13744368b34ffe79eec49c02, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:42.793940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098c8fb-fb4a-4571-ad9b-9514ff27d361 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:42.807332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 597/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:29:42 2022] PUT /identity/v3/projects/d1adf8dbab494cb886acf31847e2cc47/users/2c9cae8d13744368b34ffe79eec49c02/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:29:44.787837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc2c15-320a-47e5-8078-0bd739e2c0be None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:44.788303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc2c15-320a-47e5-8078-0bd739e2c0be None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:44.788395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc2c15-320a-47e5-8078-0bd739e2c0be None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:44.789721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 596/1193] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:29:44.794909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9ce9b-c6dc-4ad7-8b97-41f47383a214 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:44.795340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9ce9b-c6dc-4ad7-8b97-41f47383a214 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:44.795494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9ce9b-c6dc-4ad7-8b97-41f47383a214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:44.817349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ffa9ce9b-c6dc-4ad7-8b97-41f47383a214 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:29:44.818540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ffa9ce9b-c6dc-4ad7-8b97-41f47383a214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:29:44.857540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:44.885043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 598/1194] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:29:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:29:44.908631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc2c15-320a-47e5-8078-0bd739e2c0be None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:45.007833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc2c15-320a-47e5-8078-0bd739e2c0be None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:45.040308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce585c-476e-4401-b2e0-388989189fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:45.040922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce585c-476e-4401-b2e0-388989189fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:45.041198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce585c-476e-4401-b2e0-388989189fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:45.041467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce585c-476e-4401-b2e0-388989189fa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:45.052541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce585c-476e-4401-b2e0-388989189fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-35ce585c-476e-4401-b2e0-388989189fa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:29:45.057394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:29:45.058476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:29:45.059538 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 597/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:29:45.064573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9ce9b-c6dc-4ad7-8b97-41f47383a214 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:45.161304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9ce9b-c6dc-4ad7-8b97-41f47383a214 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:45.193887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584a9b2-e171-4d82-a52b-39cddc6fc9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:45.194492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584a9b2-e171-4d82-a52b-39cddc6fc9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:45.194773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584a9b2-e171-4d82-a52b-39cddc6fc9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:45.195075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584a9b2-e171-4d82-a52b-39cddc6fc9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:45.195784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584a9b2-e171-4d82-a52b-39cddc6fc9b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:45.196087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584a9b2-e171-4d82-a52b-39cddc6fc9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:45.197438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584a9b2-e171-4d82-a52b-39cddc6fc9b7 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:45.205875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 599/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:29:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:45.211584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce585c-476e-4401-b2e0-388989189fa1 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:45.242423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:45.309039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce585c-476e-4401-b2e0-388989189fa1 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:45.341891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c95b-df0c-4ae0-a991-aa42d279b2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:45.342516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c95b-df0c-4ae0-a991-aa42d279b2dc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:45.342794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c95b-df0c-4ae0-a991-aa42d279b2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:45.343086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c95b-df0c-4ae0-a991-aa42d279b2dc None admin] PATH_INFO: `/v3/users/2c9cae8d13744368b34ffe79eec49c02` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:45.344231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9c95b-df0c-4ae0-a991-aa42d279b2dc None admin] RBAC: Authorizing `identity:get_user(user_id=2c9cae8d13744368b34ffe79eec49c02)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:45.345663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9c95b-df0c-4ae0-a991-aa42d279b2dc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:45.347287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 598/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Aug 4 04:29:45 2022] GET /identity/v3/users/2c9cae8d13744368b34ffe79eec49c02 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:45.352957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584a9b2-e171-4d82-a52b-39cddc6fc9b7 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:45.388287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:45.465077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584a9b2-e171-4d82-a52b-39cddc6fc9b7 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:45.498887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8c477-1784-404c-9a33-67e00eda6f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:45.499520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8c477-1784-404c-9a33-67e00eda6f31 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:45.499797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8c477-1784-404c-9a33-67e00eda6f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:45.500068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8c477-1784-404c-9a33-67e00eda6f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:45.564945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8c477-1784-404c-9a33-67e00eda6f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:45.566307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8c477-1784-404c-9a33-67e00eda6f31 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:45.599185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:45.662920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 600/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:29:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:29:45.668851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c95b-df0c-4ae0-a991-aa42d279b2dc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:45.792978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:45.797346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c95b-df0c-4ae0-a991-aa42d279b2dc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:45.833350 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4e9ff-e4c3-4b8c-878e-46f89ae66254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:45.833899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4e9ff-e4c3-4b8c-878e-46f89ae66254 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:45.834173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4e9ff-e4c3-4b8c-878e-46f89ae66254 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:45.834449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4e9ff-e4c3-4b8c-878e-46f89ae66254 None admin] PATH_INFO: `/v3/projects/d1adf8dbab494cb886acf31847e2cc47` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:45.835623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4e9ff-e4c3-4b8c-878e-46f89ae66254 None admin] RBAC: Authorizing `identity:get_project(project_id=d1adf8dbab494cb886acf31847e2cc47)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:45.837051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4e9ff-e4c3-4b8c-878e-46f89ae66254 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:45.838716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 599/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Aug 4 04:29:45 2022] GET /identity/v3/projects/d1adf8dbab494cb886acf31847e2cc47 => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:45.845803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8c477-1784-404c-9a33-67e00eda6f31 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:29:45.942836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8c477-1784-404c-9a33-67e00eda6f31 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:29:45.976397 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35818707-b98d-4a10-8065-0f5f1f9bcd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:29:45.976997 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818707-b98d-4a10-8065-0f5f1f9bcd02 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:29:45.977276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818707-b98d-4a10-8065-0f5f1f9bcd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:29:45.977549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818707-b98d-4a10-8065-0f5f1f9bcd02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:29:45.978324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818707-b98d-4a10-8065-0f5f1f9bcd02 None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=d1adf8dbab494cb886acf31847e2cc47, user.id=2c9cae8d13744368b34ffe79eec49c02) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:29:45.978628 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818707-b98d-4a10-8065-0f5f1f9bcd02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:29:45.980072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818707-b98d-4a10-8065-0f5f1f9bcd02 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:29:45.982933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:29:45.986565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 601/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:29:45 2022] GET /identity/v3/role_assignments?user.id=2c9cae8d13744368b34ffe79eec49c02&scope.project.id=d1adf8dbab494cb886acf31847e2cc47&role.id=c1429555635349208e8b2bd908436746 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:29:55.829101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=16 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:44.170289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3ef23-6985-44d6-9c40-c35195a8ab86 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:44.170974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3ef23-6985-44d6-9c40-c35195a8ab86 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:44.170974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3ef23-6985-44d6-9c40-c35195a8ab86 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:44.172801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 600/1201] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:30:44.178974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb3a74-5ddd-478c-b403-8c67145be9f7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:44.179543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb3a74-5ddd-478c-b403-8c67145be9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:44.179543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb3a74-5ddd-478c-b403-8c67145be9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:44.201530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b6fb3a74-5ddd-478c-b403-8c67145be9f7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:30:44.202961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b6fb3a74-5ddd-478c-b403-8c67145be9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:30:44.327028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 602/1202] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:30:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:30:44.342266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3ef23-6985-44d6-9c40-c35195a8ab86 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:44.489627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3ef23-6985-44d6-9c40-c35195a8ab86 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:44.530548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166773e-e32e-4f7d-94e4-1e58efad9042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:44.531228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166773e-e32e-4f7d-94e4-1e58efad9042 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:44.531731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166773e-e32e-4f7d-94e4-1e58efad9042 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:44.533514 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166773e-e32e-4f7d-94e4-1e58efad9042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:44.545717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166773e-e32e-4f7d-94e4-1e58efad9042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:44.547439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166773e-e32e-4f7d-94e4-1e58efad9042 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b166773e-e32e-4f7d-94e4-1e58efad9042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:30:44.569596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:44.570821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:44.572156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:30:44.572156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:30:44.572156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:44.572156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:30:44.580205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 601/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:44.581802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb3a74-5ddd-478c-b403-8c67145be9f7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:44.717466 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb3a74-5ddd-478c-b403-8c67145be9f7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:44.772502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:44.782322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d1c79-6b01-43ff-bc81-f9076265d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:44.783402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d1c79-6b01-43ff-bc81-f9076265d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:44.783923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d1c79-6b01-43ff-bc81-f9076265d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:44.784411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d1c79-6b01-43ff-bc81-f9076265d8e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:44.785318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d1c79-6b01-43ff-bc81-f9076265d8e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:44.785826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d1c79-6b01-43ff-bc81-f9076265d8e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:44.787802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d1c79-6b01-43ff-bc81-f9076265d8e1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:44.811098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 603/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:30:44.818018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166773e-e32e-4f7d-94e4-1e58efad9042 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:44.883399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:44.952058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166773e-e32e-4f7d-94e4-1e58efad9042 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:44.994795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef531-c7ec-489b-bb36-279f3c428ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:44.995451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef531-c7ec-489b-bb36-279f3c428ae7 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:44.995771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef531-c7ec-489b-bb36-279f3c428ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:44.996141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef531-c7ec-489b-bb36-279f3c428ae7 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:44.996952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fef531-c7ec-489b-bb36-279f3c428ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:44.999042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fef531-c7ec-489b-bb36-279f3c428ae7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:45.037136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 602/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Aug 4 04:30:44 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:30:47.223557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f6f64-24cc-48d6-810a-b177fdce20f4 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:47.224111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f6f64-24cc-48d6-810a-b177fdce20f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:47.224111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f6f64-24cc-48d6-810a-b177fdce20f4 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:47.225659 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 604/1206] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:30:47.231447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdca2a-ae93-4f1a-a3ad-fc1dea18ed7e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:47.231887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdca2a-ae93-4f1a-a3ad-fc1dea18ed7e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:47.232075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdca2a-ae93-4f1a-a3ad-fc1dea18ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:47.255293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b0bdca2a-ae93-4f1a-a3ad-fc1dea18ed7e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:30:47.256885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b0bdca2a-ae93-4f1a-a3ad-fc1dea18ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:30:47.340747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 603/1207] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:30:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:30:47.364372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f6f64-24cc-48d6-810a-b177fdce20f4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:47.504659 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f6f64-24cc-48d6-810a-b177fdce20f4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:47.549880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70900189-8dc7-4263-bf1e-d7f346c9264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:47.550522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70900189-8dc7-4263-bf1e-d7f346c9264c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:47.550797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70900189-8dc7-4263-bf1e-d7f346c9264c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:47.551102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70900189-8dc7-4263-bf1e-d7f346c9264c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:47.563739 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70900189-8dc7-4263-bf1e-d7f346c9264c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-70900189-8dc7-4263-bf1e-d7f346c9264c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:30:47.568782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:47.570055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:47.570914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 605/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:30:47.576433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdca2a-ae93-4f1a-a3ad-fc1dea18ed7e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:47.621040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:47.687928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdca2a-ae93-4f1a-a3ad-fc1dea18ed7e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:47.736149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194520-6715-4c1c-8262-717fb06d38c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:47.737075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194520-6715-4c1c-8262-717fb06d38c0 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:47.737349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194520-6715-4c1c-8262-717fb06d38c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:47.737619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194520-6715-4c1c-8262-717fb06d38c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:47.738328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c194520-6715-4c1c-8262-717fb06d38c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:47.738628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c194520-6715-4c1c-8262-717fb06d38c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:47.740030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c194520-6715-4c1c-8262-717fb06d38c0 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:47.755345 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 604/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:47.757626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70900189-8dc7-4263-bf1e-d7f346c9264c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:47.828248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:47.884507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70900189-8dc7-4263-bf1e-d7f346c9264c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:47.920546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2f3b9-2b7d-4f6f-839c-a012f027b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:47.921181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2f3b9-2b7d-4f6f-839c-a012f027b602 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:47.921488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2f3b9-2b7d-4f6f-839c-a012f027b602 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:47.922758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2f3b9-2b7d-4f6f-839c-a012f027b602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:47.933540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2f3b9-2b7d-4f6f-839c-a012f027b602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:47.935205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2f3b9-2b7d-4f6f-839c-a012f027b602 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-8ce2f3b9-2b7d-4f6f-839c-a012f027b602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:30:47.949933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:47.950891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:47.951819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:30:47.951819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:30:47.951819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:47.951819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:47.951819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 606/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:47.957056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194520-6715-4c1c-8262-717fb06d38c0 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:48.065683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:48.069359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194520-6715-4c1c-8262-717fb06d38c0 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:48.107526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1a865-4ab9-4eb6-95ab-479ee09881d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:48.109667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1a865-4ab9-4eb6-95ab-479ee09881d3 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:48.109667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1a865-4ab9-4eb6-95ab-479ee09881d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:48.109667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1a865-4ab9-4eb6-95ab-479ee09881d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:48.109667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1a865-4ab9-4eb6-95ab-479ee09881d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:48.110329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1a865-4ab9-4eb6-95ab-479ee09881d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:48.111862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1a865-4ab9-4eb6-95ab-479ee09881d3 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:48.127025 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 605/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:30:48.129730 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2f3b9-2b7d-4f6f-839c-a012f027b602 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:48.271330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2f3b9-2b7d-4f6f-839c-a012f027b602 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:48.273072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:48.309508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cf25a-3212-40dc-afa7-b033bf282e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:48.310147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cf25a-3212-40dc-afa7-b033bf282e27 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:48.310423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cf25a-3212-40dc-afa7-b033bf282e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:48.310693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cf25a-3212-40dc-afa7-b033bf282e27 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:48.320021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cf25a-3212-40dc-afa7-b033bf282e27 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:48.320178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cf25a-3212-40dc-afa7-b033bf282e27 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-bb7cf25a-3212-40dc-afa7-b033bf282e27 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:30:48.332121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:48.333188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:48.334784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 607/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:48.339721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1a865-4ab9-4eb6-95ab-479ee09881d3 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:48.459470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1a865-4ab9-4eb6-95ab-479ee09881d3 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:48.496099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b8bd4-7619-4448-87b6-70ee321ff406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:48.496765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b8bd4-7619-4448-87b6-70ee321ff406 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:48.497050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b8bd4-7619-4448-87b6-70ee321ff406 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:48.497346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b8bd4-7619-4448-87b6-70ee321ff406 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:48.498204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b8bd4-7619-4448-87b6-70ee321ff406 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:48.498533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b8bd4-7619-4448-87b6-70ee321ff406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:48.500249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b8bd4-7619-4448-87b6-70ee321ff406 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:48.530547 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 606/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Aug 4 04:30:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:30:48.531873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cf25a-3212-40dc-afa7-b033bf282e27 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:48.668106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cf25a-3212-40dc-afa7-b033bf282e27 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:48.710773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042eaf3-cebe-4317-a94c-d3e014a3077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:48.711514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042eaf3-cebe-4317-a94c-d3e014a3077c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:48.711793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042eaf3-cebe-4317-a94c-d3e014a3077c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:48.713424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042eaf3-cebe-4317-a94c-d3e014a3077c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:48.752665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:48.805156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042eaf3-cebe-4317-a94c-d3e014a3077c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:48.807210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042eaf3-cebe-4317-a94c-d3e014a3077c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:48.933262 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 608/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:30:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:30:48.939735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b8bd4-7619-4448-87b6-70ee321ff406 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:48.963945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:49.051889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b8bd4-7619-4448-87b6-70ee321ff406 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:49.087544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df5d8a-6115-4a9c-8c29-9f084722ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:49.088213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df5d8a-6115-4a9c-8c29-9f084722ba49 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:49.088519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df5d8a-6115-4a9c-8c29-9f084722ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:49.088815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df5d8a-6115-4a9c-8c29-9f084722ba49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:49.099405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df5d8a-6115-4a9c-8c29-9f084722ba49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:49.101107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df5d8a-6115-4a9c-8c29-9f084722ba49 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-38df5d8a-6115-4a9c-8c29-9f084722ba49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:30:49.117919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:49.119103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:49.120810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:30:49.120810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:30:49.120810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:49.120810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:30:49.124435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 607/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:30:49.125265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042eaf3-cebe-4317-a94c-d3e014a3077c None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:49.190144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:49.232268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042eaf3-cebe-4317-a94c-d3e014a3077c None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:49.269800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc2515-5a1e-4435-9339-c3f7af424029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:49.270440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc2515-5a1e-4435-9339-c3f7af424029 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:49.270797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc2515-5a1e-4435-9339-c3f7af424029 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:49.271111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc2515-5a1e-4435-9339-c3f7af424029 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:49.271863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc2515-5a1e-4435-9339-c3f7af424029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:49.272428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc2515-5a1e-4435-9339-c3f7af424029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:49.274269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc2515-5a1e-4435-9339-c3f7af424029 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:49.287537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 609/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:49.293455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df5d8a-6115-4a9c-8c29-9f084722ba49 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:49.367426 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:49.401319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df5d8a-6115-4a9c-8c29-9f084722ba49 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:49.437955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f3df-5694-4e16-b3b3-68d80df996db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:49.438598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f3df-5694-4e16-b3b3-68d80df996db None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:49.439947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f3df-5694-4e16-b3b3-68d80df996db None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:49.439947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f3df-5694-4e16-b3b3-68d80df996db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:49.446503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177f3df-5694-4e16-b3b3-68d80df996db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:49.447974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177f3df-5694-4e16-b3b3-68d80df996db None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-b177f3df-5694-4e16-b3b3-68d80df996db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:30:49.459289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:49.460369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:49.461398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:30:49.461398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:30:49.461398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:30:49.461398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:30:49.461398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:30:49.461398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:30:49.461398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:30:49.461398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:30:49.461398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 608/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:49.466803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc2515-5a1e-4435-9339-c3f7af424029 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:49.574461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc2515-5a1e-4435-9339-c3f7af424029 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:49.600354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:49.615834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f06d42-6f18-498b-8da6-fe86390bb71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:49.616463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f06d42-6f18-498b-8da6-fe86390bb71f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:49.616748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f06d42-6f18-498b-8da6-fe86390bb71f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:49.617224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f06d42-6f18-498b-8da6-fe86390bb71f None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:49.618049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f06d42-6f18-498b-8da6-fe86390bb71f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:49.618422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f06d42-6f18-498b-8da6-fe86390bb71f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:49.619985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f06d42-6f18-498b-8da6-fe86390bb71f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:49.633065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 610/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:49.639672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f3df-5694-4e16-b3b3-68d80df996db None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:49.753299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f3df-5694-4e16-b3b3-68d80df996db None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:49.792748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:49.801196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65467217-631d-4a61-a789-7f0c90e9db1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:49.801833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65467217-631d-4a61-a789-7f0c90e9db1b None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:49.802139 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65467217-631d-4a61-a789-7f0c90e9db1b None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:49.802409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65467217-631d-4a61-a789-7f0c90e9db1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:49.803217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65467217-631d-4a61-a789-7f0c90e9db1b None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=a5c20a5a655b43d1899bf2319647a894) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:49.803634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65467217-631d-4a61-a789-7f0c90e9db1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:49.805050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65467217-631d-4a61-a789-7f0c90e9db1b None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:49.811173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 609/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:30:49 2022] GET /identity/v3/role_assignments?user.id=a5c20a5a655b43d1899bf2319647a894&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:30:52.018124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05270eab-3cc3-4aa8-97d6-e36674d7b7c9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:52.018631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05270eab-3cc3-4aa8-97d6-e36674d7b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:52.018631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05270eab-3cc3-4aa8-97d6-e36674d7b7c9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:52.019970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 611/1220] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:30:52.025698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e505e-4754-418e-89c7-e2cda7b8016d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:52.026195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e505e-4754-418e-89c7-e2cda7b8016d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:52.026312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e505e-4754-418e-89c7-e2cda7b8016d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:52.045735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ad8e505e-4754-418e-89c7-e2cda7b8016d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:30:52.047354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ad8e505e-4754-418e-89c7-e2cda7b8016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:30:52.123059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 610/1221] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:30:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:30:52.148854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05270eab-3cc3-4aa8-97d6-e36674d7b7c9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:52.253318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05270eab-3cc3-4aa8-97d6-e36674d7b7c9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:52.287827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eba0b4-a355-4ab6-a3a2-124d92a9dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:52.288362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eba0b4-a355-4ab6-a3a2-124d92a9dd9d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:52.288635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eba0b4-a355-4ab6-a3a2-124d92a9dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:52.288922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eba0b4-a355-4ab6-a3a2-124d92a9dd9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:52.299939 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eba0b4-a355-4ab6-a3a2-124d92a9dd9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-22eba0b4-a355-4ab6-a3a2-124d92a9dd9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:30:52.305033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:52.306013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:52.307574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 612/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:30:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:52.313692 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e505e-4754-418e-89c7-e2cda7b8016d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:52.433034 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e505e-4754-418e-89c7-e2cda7b8016d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:52.460275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:52.471196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f787d-8e35-4d0c-985d-041fa2bd769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:52.471808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f787d-8e35-4d0c-985d-041fa2bd769d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:52.472086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f787d-8e35-4d0c-985d-041fa2bd769d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:52.472356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f787d-8e35-4d0c-985d-041fa2bd769d None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:52.473069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f787d-8e35-4d0c-985d-041fa2bd769d None admin] RBAC: Adding query filter params (name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:52.473368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f787d-8e35-4d0c-985d-041fa2bd769d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:52.474733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f787d-8e35-4d0c-985d-041fa2bd769d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:52.482814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 611/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:30:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:52.488629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eba0b4-a355-4ab6-a3a2-124d92a9dd9d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:52.534703 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:52.599891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eba0b4-a355-4ab6-a3a2-124d92a9dd9d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:52.642802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b56caf-4d88-4251-b3ad-87208f36a2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:52.643743 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56caf-4d88-4251-b3ad-87208f36a2bb None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:52.644093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56caf-4d88-4251-b3ad-87208f36a2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:52.644454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56caf-4d88-4251-b3ad-87208f36a2bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:52.659279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b56caf-4d88-4251-b3ad-87208f36a2bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:52.660902 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b56caf-4d88-4251-b3ad-87208f36a2bb None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-c7b56caf-4d88-4251-b3ad-87208f36a2bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:30:52.679393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:52.680322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:52.681204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:30:52.681204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:30:52.681204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:52.681204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:52.681204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 613/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:52.686773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f787d-8e35-4d0c-985d-041fa2bd769d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:52.802670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f787d-8e35-4d0c-985d-041fa2bd769d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:52.839639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec222957-1300-4ede-8ed9-c3fdc7be0f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:52.840246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222957-1300-4ede-8ed9-c3fdc7be0f4f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:52.840535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222957-1300-4ede-8ed9-c3fdc7be0f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:52.840776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222957-1300-4ede-8ed9-c3fdc7be0f4f None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:52.841524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec222957-1300-4ede-8ed9-c3fdc7be0f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:52.841754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec222957-1300-4ede-8ed9-c3fdc7be0f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:52.843113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec222957-1300-4ede-8ed9-c3fdc7be0f4f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:52.855859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 612/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:52.861626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b56caf-4d88-4251-b3ad-87208f36a2bb None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:52.965910 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:52.973330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b56caf-4d88-4251-b3ad-87208f36a2bb None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:53.011713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62841f36-b5c3-414d-b59f-ad27bd9f48d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:53.012353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62841f36-b5c3-414d-b59f-ad27bd9f48d1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:53.012633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62841f36-b5c3-414d-b59f-ad27bd9f48d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:53.012908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62841f36-b5c3-414d-b59f-ad27bd9f48d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:53.020338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62841f36-b5c3-414d-b59f-ad27bd9f48d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:53.021778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62841f36-b5c3-414d-b59f-ad27bd9f48d1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-62841f36-b5c3-414d-b59f-ad27bd9f48d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:30:53.035424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:53.036627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:53.037711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 614/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:53.043423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec222957-1300-4ede-8ed9-c3fdc7be0f4f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:53.096455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:53.162394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec222957-1300-4ede-8ed9-c3fdc7be0f4f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:53.204524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e6e9-b279-444f-ad79-9b4c4f231b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:53.205220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e6e9-b279-444f-ad79-9b4c4f231b89 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:53.205555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e6e9-b279-444f-ad79-9b4c4f231b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:53.205853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e6e9-b279-444f-ad79-9b4c4f231b89 None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:53.206766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4e6e9-b279-444f-ad79-9b4c4f231b89 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:53.207136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4e6e9-b279-444f-ad79-9b4c4f231b89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:53.208795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4e6e9-b279-444f-ad79-9b4c4f231b89 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:53.229609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 613/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Aug 4 04:30:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:53.235491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62841f36-b5c3-414d-b59f-ad27bd9f48d1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:53.355717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62841f36-b5c3-414d-b59f-ad27bd9f48d1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:53.394951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f15e74-faa5-4461-8519-6e51fcc96a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:53.395615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f15e74-faa5-4461-8519-6e51fcc96a7a None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:53.395946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f15e74-faa5-4461-8519-6e51fcc96a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:53.396319 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f15e74-faa5-4461-8519-6e51fcc96a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:53.408332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f15e74-faa5-4461-8519-6e51fcc96a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:53.409788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f15e74-faa5-4461-8519-6e51fcc96a7a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-89f15e74-faa5-4461-8519-6e51fcc96a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:30:53.425349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:53.426588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:53.427580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:30:53.427580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:30:53.427580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:53.427580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:53.427580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 615/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:53.433098 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e6e9-b279-444f-ad79-9b4c4f231b89 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:53.551798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e6e9-b279-444f-ad79-9b4c4f231b89 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:53.554389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:53.591851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ebc01-6c30-461f-b6b4-73e8684f0c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:53.592889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ebc01-6c30-461f-b6b4-73e8684f0c1d None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:53.593309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ebc01-6c30-461f-b6b4-73e8684f0c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:53.593776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ebc01-6c30-461f-b6b4-73e8684f0c1d None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:53.594819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ebc01-6c30-461f-b6b4-73e8684f0c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:53.595304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ebc01-6c30-461f-b6b4-73e8684f0c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:53.597194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ebc01-6c30-461f-b6b4-73e8684f0c1d None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:53.610490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 614/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:53.616065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f15e74-faa5-4461-8519-6e51fcc96a7a None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:53.627794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:53.733865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f15e74-faa5-4461-8519-6e51fcc96a7a None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:53.772679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9b7dc-2ba9-4c71-9998-3513774896a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:53.773321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b7dc-2ba9-4c71-9998-3513774896a1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:53.773607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b7dc-2ba9-4c71-9998-3513774896a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:53.773869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b7dc-2ba9-4c71-9998-3513774896a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:53.781316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9b7dc-2ba9-4c71-9998-3513774896a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:53.782735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9b7dc-2ba9-4c71-9998-3513774896a1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f0c9b7dc-2ba9-4c71-9998-3513774896a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:30:53.794769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:53.795884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:53.797254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:30:53.797254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:30:53.797254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:30:53.797254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:30:53.797254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:30:53.797254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:30:53.797254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:30:53.797254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:53.797254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 616/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:30:53.802447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ebc01-6c30-461f-b6b4-73e8684f0c1d None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:53.916799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ebc01-6c30-461f-b6b4-73e8684f0c1d None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:53.950730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ebfb6-a1cd-494c-a93f-0523d0a24711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:53.951376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ebfb6-a1cd-494c-a93f-0523d0a24711 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:53.951652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ebfb6-a1cd-494c-a93f-0523d0a24711 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:53.951924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ebfb6-a1cd-494c-a93f-0523d0a24711 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:53.952671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ebfb6-a1cd-494c-a93f-0523d0a24711 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:53.952971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ebfb6-a1cd-494c-a93f-0523d0a24711 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:53.954515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ebfb6-a1cd-494c-a93f-0523d0a24711 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:53.968146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 615/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:53.974227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9b7dc-2ba9-4c71-9998-3513774896a1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:54.052830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:54.088186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9b7dc-2ba9-4c71-9998-3513774896a1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:54.122096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859a040-483f-4d29-ae41-988e678b977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:54.122747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859a040-483f-4d29-ae41-988e678b977b None admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:54.123057 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859a040-483f-4d29-ae41-988e678b977b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:54.123332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859a040-483f-4d29-ae41-988e678b977b None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/a5c20a5a655b43d1899bf2319647a894/roles/e1668813c1fa4ab5af30b933fa7ee73e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:54.139131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859a040-483f-4d29-ae41-988e678b977b None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=a5c20a5a655b43d1899bf2319647a894, role_id=e1668813c1fa4ab5af30b933fa7ee73e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:54.140673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859a040-483f-4d29-ae41-988e678b977b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:54.153998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 617/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:30:53 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/a5c20a5a655b43d1899bf2319647a894/roles/e1668813c1fa4ab5af30b933fa7ee73e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:30:56.242878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b3c57-a880-4470-86a5-bcbfb6f1abb8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:56.243512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b3c57-a880-4470-86a5-bcbfb6f1abb8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:56.243512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b3c57-a880-4470-86a5-bcbfb6f1abb8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:56.245347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 616/1233] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:30:56.251574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518091f-71b7-4c3d-9eea-361d01faf2c1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:56.252308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518091f-71b7-4c3d-9eea-361d01faf2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:56.252308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518091f-71b7-4c3d-9eea-361d01faf2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:56.271834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8518091f-71b7-4c3d-9eea-361d01faf2c1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:30:56.273004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8518091f-71b7-4c3d-9eea-361d01faf2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:30:56.347595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 618/1234] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:30:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:30:56.371730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b3c57-a880-4470-86a5-bcbfb6f1abb8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:56.397459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:56.486275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b3c57-a880-4470-86a5-bcbfb6f1abb8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:56.520804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7103651-9a44-4765-a102-3cce6305b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:56.521356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7103651-9a44-4765-a102-3cce6305b594 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:56.521636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7103651-9a44-4765-a102-3cce6305b594 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:56.521905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7103651-9a44-4765-a102-3cce6305b594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:56.532591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7103651-9a44-4765-a102-3cce6305b594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-d7103651-9a44-4765-a102-3cce6305b594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:30:56.538251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:56.539433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:30:56.545889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 617/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Aug 4 04:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:56.547105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518091f-71b7-4c3d-9eea-361d01faf2c1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:56.597176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:56.654502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518091f-71b7-4c3d-9eea-361d01faf2c1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:56.693835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96e5d-1aac-4359-a3f4-e8062569750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:56.694533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96e5d-1aac-4359-a3f4-e8062569750d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:56.694879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96e5d-1aac-4359-a3f4-e8062569750d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:56.695178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96e5d-1aac-4359-a3f4-e8062569750d None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:56.695934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e96e5d-1aac-4359-a3f4-e8062569750d None admin] RBAC: Adding query filter params (name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:56.696286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e96e5d-1aac-4359-a3f4-e8062569750d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:56.697820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e96e5d-1aac-4359-a3f4-e8062569750d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:56.706553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 619/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Aug 4 04:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:30:56.712550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7103651-9a44-4765-a102-3cce6305b594 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:56.806471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:56.823592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7103651-9a44-4765-a102-3cce6305b594 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:56.859965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08db2be-94d7-425a-b745-9ea13d3745bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:56.860569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08db2be-94d7-425a-b745-9ea13d3745bc None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:56.860844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08db2be-94d7-425a-b745-9ea13d3745bc None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:56.861115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08db2be-94d7-425a-b745-9ea13d3745bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:56.871249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08db2be-94d7-425a-b745-9ea13d3745bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:56.872704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08db2be-94d7-425a-b745-9ea13d3745bc None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-a08db2be-94d7-425a-b745-9ea13d3745bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:30:56.887459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:56.888372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:56.889251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:30:56.889251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:30:56.889251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:56.889251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:30:56.889251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 618/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:56.894450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96e5d-1aac-4359-a3f4-e8062569750d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:57.002132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96e5d-1aac-4359-a3f4-e8062569750d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:57.011911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:57.045173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8bcaf-a00a-4ff2-bccf-68c77c842703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:57.045786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bcaf-a00a-4ff2-bccf-68c77c842703 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:57.046071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bcaf-a00a-4ff2-bccf-68c77c842703 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:57.046331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bcaf-a00a-4ff2-bccf-68c77c842703 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:57.047315 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8bcaf-a00a-4ff2-bccf-68c77c842703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:57.047615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8bcaf-a00a-4ff2-bccf-68c77c842703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:57.049025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8bcaf-a00a-4ff2-bccf-68c77c842703 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:57.060947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 620/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:57.066661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08db2be-94d7-425a-b745-9ea13d3745bc None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:57.166833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08db2be-94d7-425a-b745-9ea13d3745bc None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:57.202340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e9af1-0761-420a-bf1d-4752e48371af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:57.203007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e9af1-0761-420a-bf1d-4752e48371af None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:57.203284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e9af1-0761-420a-bf1d-4752e48371af None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:57.203579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e9af1-0761-420a-bf1d-4752e48371af None admin] PATH_INFO: `/v3/users/placement` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:57.206864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:57.212233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e9af1-0761-420a-bf1d-4752e48371af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:57.214178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e9af1-0761-420a-bf1d-4752e48371af None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-2c0e9af1-0761-420a-bf1d-4752e48371af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:30:57.226564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:57.228717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:30:57.229858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 619/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:30:57.237355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8bcaf-a00a-4ff2-bccf-68c77c842703 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:57.354291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8bcaf-a00a-4ff2-bccf-68c77c842703 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:57.392211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3c678-f1c8-4731-9031-28350e562f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:57.392825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3c678-f1c8-4731-9031-28350e562f43 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:57.393099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3c678-f1c8-4731-9031-28350e562f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:57.393368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3c678-f1c8-4731-9031-28350e562f43 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:57.394292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3c678-f1c8-4731-9031-28350e562f43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:57.394629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3c678-f1c8-4731-9031-28350e562f43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:57.396256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3c678-f1c8-4731-9031-28350e562f43 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:57.415399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 621/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Aug 4 04:30:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:57.423194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e9af1-0761-420a-bf1d-4752e48371af None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:57.547654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e9af1-0761-420a-bf1d-4752e48371af None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:57.607442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0ad90-e9e8-4bcc-b911-0336b48eb7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:57.607964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ad90-e9e8-4bcc-b911-0336b48eb7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:57.608250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ad90-e9e8-4bcc-b911-0336b48eb7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:57.608523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0ad90-e9e8-4bcc-b911-0336b48eb7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:57.675965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:57.684770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0ad90-e9e8-4bcc-b911-0336b48eb7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:57.686234 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0ad90-e9e8-4bcc-b911-0336b48eb7f7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:57.798728 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 620/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:30:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:30:57.805210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3c678-f1c8-4731-9031-28350e562f43 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:57.835417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:57.916554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3c678-f1c8-4731-9031-28350e562f43 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:57.953017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219bb56-54d4-4e55-bb5b-7095ccd79a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:57.953672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219bb56-54d4-4e55-bb5b-7095ccd79a82 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:57.954003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219bb56-54d4-4e55-bb5b-7095ccd79a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:57.954354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219bb56-54d4-4e55-bb5b-7095ccd79a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:57.966548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219bb56-54d4-4e55-bb5b-7095ccd79a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:57.968182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219bb56-54d4-4e55-bb5b-7095ccd79a82 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-6219bb56-54d4-4e55-bb5b-7095ccd79a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:30:57.985205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:57.986208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:57.987170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:30:57.987170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:30:57.987170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:30:57.987170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:57.987170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 622/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:57.992250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0ad90-e9e8-4bcc-b911-0336b48eb7f7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:58.105600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:58.117210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0ad90-e9e8-4bcc-b911-0336b48eb7f7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:58.160731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d820-97fe-4896-a926-526e1a46a690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:58.161429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d820-97fe-4896-a926-526e1a46a690 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:58.161706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d820-97fe-4896-a926-526e1a46a690 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:58.161976 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d820-97fe-4896-a926-526e1a46a690 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:58.162671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888d820-97fe-4896-a926-526e1a46a690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:58.163006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888d820-97fe-4896-a926-526e1a46a690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:58.164575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888d820-97fe-4896-a926-526e1a46a690 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:58.178814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 621/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:58.185583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219bb56-54d4-4e55-bb5b-7095ccd79a82 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:58.284026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:30:58.314212 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219bb56-54d4-4e55-bb5b-7095ccd79a82 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:58.362853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83d46b-595e-45b5-9b64-22ec1df836ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:58.363820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83d46b-595e-45b5-9b64-22ec1df836ce None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:58.364217 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83d46b-595e-45b5-9b64-22ec1df836ce None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:58.364572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83d46b-595e-45b5-9b64-22ec1df836ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:58.373979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83d46b-595e-45b5-9b64-22ec1df836ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:58.375838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83d46b-595e-45b5-9b64-22ec1df836ce None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-cb83d46b-595e-45b5-9b64-22ec1df836ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:30:58.390758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:30:58.391744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:30:58.392710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:30:58.392710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:30:58.392710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:30:58.392710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:30:58.392710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:30:58.392710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:30:58.392710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:30:58.392710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:30:58.392710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 623/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:30:58.398791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d820-97fe-4896-a926-526e1a46a690 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:58.530470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d820-97fe-4896-a926-526e1a46a690 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:58.571699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7abd4d-1fec-414b-a271-1075edc9b316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:58.572657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7abd4d-1fec-414b-a271-1075edc9b316 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:58.572985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7abd4d-1fec-414b-a271-1075edc9b316 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:58.573327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7abd4d-1fec-414b-a271-1075edc9b316 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:58.574585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7abd4d-1fec-414b-a271-1075edc9b316 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:58.575221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7abd4d-1fec-414b-a271-1075edc9b316 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:58.577647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7abd4d-1fec-414b-a271-1075edc9b316 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:58.593805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 622/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:30:58.600685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83d46b-595e-45b5-9b64-22ec1df836ce None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:30:58.717240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83d46b-595e-45b5-9b64-22ec1df836ce None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:30:58.751636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600393b-52e7-4109-a04c-69a9deea0ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:30:58.752248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600393b-52e7-4109-a04c-69a9deea0ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:30:58.752542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600393b-52e7-4109-a04c-69a9deea0ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:30:58.753101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600393b-52e7-4109-a04c-69a9deea0ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:30:58.753574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600393b-52e7-4109-a04c-69a9deea0ab5 None admin] RBAC: Adding query filter params (role.id=e1668813c1fa4ab5af30b933fa7ee73e, scope.project.id=642faef2d1654874bd7205420512998a, user.id=a5c20a5a655b43d1899bf2319647a894) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:30:58.753884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600393b-52e7-4109-a04c-69a9deea0ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:30:58.755347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600393b-52e7-4109-a04c-69a9deea0ab5 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:30:58.762006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 624/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:30:58 2022] GET /identity/v3/role_assignments?user.id=a5c20a5a655b43d1899bf2319647a894&scope.project.id=642faef2d1654874bd7205420512998a&role.id=e1668813c1fa4ab5af30b933fa7ee73e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:01.055627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b180f9-5005-4903-b6de-dddeddff66ec None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:01.056159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b180f9-5005-4903-b6de-dddeddff66ec None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:01.056266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b180f9-5005-4903-b6de-dddeddff66ec None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:01.057714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 623/1247] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:31:01.066876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad16bcb-1203-4cec-b642-2ac1fc699358 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:01.067406 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad16bcb-1203-4cec-b642-2ac1fc699358 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:01.067520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad16bcb-1203-4cec-b642-2ac1fc699358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:01.075323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:01.090913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8ad16bcb-1203-4cec-b642-2ac1fc699358 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:31:01.092162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8ad16bcb-1203-4cec-b642-2ac1fc699358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:31:01.166100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 625/1248] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:31:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:31:01.191945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b180f9-5005-4903-b6de-dddeddff66ec None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:01.214121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:01.328604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b180f9-5005-4903-b6de-dddeddff66ec None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:01.374413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa098b-85be-4f03-b988-e46527315e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:01.375126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa098b-85be-4f03-b988-e46527315e1c None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:01.375528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa098b-85be-4f03-b988-e46527315e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:01.375911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa098b-85be-4f03-b988-e46527315e1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:01.390837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa098b-85be-4f03-b988-e46527315e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-4caa098b-85be-4f03-b988-e46527315e1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:31:01.397093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:01.398186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:01.399112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 624/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:01.407372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad16bcb-1203-4cec-b642-2ac1fc699358 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:01.550370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad16bcb-1203-4cec-b642-2ac1fc699358 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:01.584809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:01.591719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4304b-83b2-49a2-8316-38cd9573e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:01.592391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4304b-83b2-49a2-8316-38cd9573e42b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:01.592688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4304b-83b2-49a2-8316-38cd9573e42b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:01.593053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4304b-83b2-49a2-8316-38cd9573e42b None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:01.593776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4304b-83b2-49a2-8316-38cd9573e42b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:01.594078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4304b-83b2-49a2-8316-38cd9573e42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:01.595568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4304b-83b2-49a2-8316-38cd9573e42b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:01.611176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 626/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:31:01.612533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa098b-85be-4f03-b988-e46527315e1c None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:01.710156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:01.748109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa098b-85be-4f03-b988-e46527315e1c None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:01.798580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020c88d-c062-45a6-8db6-c14f9c698520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:01.799276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020c88d-c062-45a6-8db6-c14f9c698520 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:01.799549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020c88d-c062-45a6-8db6-c14f9c698520 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:01.799811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020c88d-c062-45a6-8db6-c14f9c698520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:01.811195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020c88d-c062-45a6-8db6-c14f9c698520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:01.812671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020c88d-c062-45a6-8db6-c14f9c698520 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-5020c88d-c062-45a6-8db6-c14f9c698520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:31:01.831658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:01.832834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:01.833937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:31:01.833937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:31:01.833937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:01.833937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:01.833937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 625/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:31:01.842139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4304b-83b2-49a2-8316-38cd9573e42b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:01.957118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4304b-83b2-49a2-8316-38cd9573e42b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:01.993381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0aff34-bb17-4813-8569-0ad0daf4ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:01.994509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aff34-bb17-4813-8569-0ad0daf4ba3d None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:01.994783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aff34-bb17-4813-8569-0ad0daf4ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:01.995089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aff34-bb17-4813-8569-0ad0daf4ba3d None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:01.995803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0aff34-bb17-4813-8569-0ad0daf4ba3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:01.996172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0aff34-bb17-4813-8569-0ad0daf4ba3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:01.997549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0aff34-bb17-4813-8569-0ad0daf4ba3d None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:02.010836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 627/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:31:02.016748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020c88d-c062-45a6-8db6-c14f9c698520 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:02.151717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020c88d-c062-45a6-8db6-c14f9c698520 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:02.179959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:02.189920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e53156-ead1-478f-9f5b-66554bf6796f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:02.190631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53156-ead1-478f-9f5b-66554bf6796f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:02.190914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53156-ead1-478f-9f5b-66554bf6796f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:02.191224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53156-ead1-478f-9f5b-66554bf6796f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:02.202435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e53156-ead1-478f-9f5b-66554bf6796f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:02.204159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e53156-ead1-478f-9f5b-66554bf6796f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-42e53156-ead1-478f-9f5b-66554bf6796f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:31:02.217604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:02.218738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:02.220297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 626/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:31:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:02.225357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0aff34-bb17-4813-8569-0ad0daf4ba3d None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:02.291259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:02.343338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0aff34-bb17-4813-8569-0ad0daf4ba3d None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:02.381419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e7f8d-146c-4f3c-ac2c-e1935878ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:02.382096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e7f8d-146c-4f3c-ac2c-e1935878ae40 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:02.382446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e7f8d-146c-4f3c-ac2c-e1935878ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:02.382965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e7f8d-146c-4f3c-ac2c-e1935878ae40 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:02.383792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e7f8d-146c-4f3c-ac2c-e1935878ae40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:02.383983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e7f8d-146c-4f3c-ac2c-e1935878ae40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:02.386111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e7f8d-146c-4f3c-ac2c-e1935878ae40 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:02.409173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 628/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Aug 4 04:31:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:31:02.414772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e53156-ead1-478f-9f5b-66554bf6796f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:02.535737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e53156-ead1-478f-9f5b-66554bf6796f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:02.575097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffcab1-1d16-4c8a-aadf-ade06c070496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:02.575716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffcab1-1d16-4c8a-aadf-ade06c070496 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:02.575990 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffcab1-1d16-4c8a-aadf-ade06c070496 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:02.576303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffcab1-1d16-4c8a-aadf-ade06c070496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:02.636398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:02.651019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffcab1-1d16-4c8a-aadf-ade06c070496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:02.652719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffcab1-1d16-4c8a-aadf-ade06c070496 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:02.777991 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 627/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:31:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:31:02.784353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e7f8d-146c-4f3c-ac2c-e1935878ae40 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:02.941644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e7f8d-146c-4f3c-ac2c-e1935878ae40 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:02.956227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:02.984584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6e9c-1c87-445d-99ae-e045c37f6562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:02.985231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6e9c-1c87-445d-99ae-e045c37f6562 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:02.985510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6e9c-1c87-445d-99ae-e045c37f6562 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:02.985779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b6e9c-1c87-445d-99ae-e045c37f6562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:02.998356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b6e9c-1c87-445d-99ae-e045c37f6562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:03.000511 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b6e9c-1c87-445d-99ae-e045c37f6562 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-7f4b6e9c-1c87-445d-99ae-e045c37f6562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:31:03.017316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:03.018522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:03.019468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:31:03.019468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:31:03.019468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:03.019468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:03.024420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 629/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 04:31:03.026066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffcab1-1d16-4c8a-aadf-ade06c070496 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:03.123122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:03.137548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffcab1-1d16-4c8a-aadf-ade06c070496 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:03.174201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020920d7-fee6-427b-8d23-e70fd0808f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:03.174920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020920d7-fee6-427b-8d23-e70fd0808f54 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:03.175119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020920d7-fee6-427b-8d23-e70fd0808f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:03.175387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020920d7-fee6-427b-8d23-e70fd0808f54 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:03.176184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020920d7-fee6-427b-8d23-e70fd0808f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:03.176381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020920d7-fee6-427b-8d23-e70fd0808f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:03.177737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020920d7-fee6-427b-8d23-e70fd0808f54 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:03.189861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 628/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:03.195770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6e9c-1c87-445d-99ae-e045c37f6562 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:03.306725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b6e9c-1c87-445d-99ae-e045c37f6562 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:03.347024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b60c46-42d2-41aa-9863-503e09ad05ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:03.347599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b60c46-42d2-41aa-9863-503e09ad05ee None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:03.347880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b60c46-42d2-41aa-9863-503e09ad05ee None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:03.348154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b60c46-42d2-41aa-9863-503e09ad05ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:03.355334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b60c46-42d2-41aa-9863-503e09ad05ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:03.356788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b60c46-42d2-41aa-9863-503e09ad05ee None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-d7b60c46-42d2-41aa-9863-503e09ad05ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:31:03.369052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:03.370360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:03.372290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:31:03.372290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:31:03.372290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:31:03.372290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:31:03.372290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:31:03.372290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:31:03.372290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:31:03.372290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:03.372290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 630/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:03.376453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020920d7-fee6-427b-8d23-e70fd0808f54 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:03.521885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020920d7-fee6-427b-8d23-e70fd0808f54 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:03.563349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9046a-5bb7-4398-8dde-c36bf530ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:03.563931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9046a-5bb7-4398-8dde-c36bf530ae42 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:03.564213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9046a-5bb7-4398-8dde-c36bf530ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:03.564492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9046a-5bb7-4398-8dde-c36bf530ae42 None admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:03.565414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9046a-5bb7-4398-8dde-c36bf530ae42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:03.565725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9046a-5bb7-4398-8dde-c36bf530ae42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:03.567315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9046a-5bb7-4398-8dde-c36bf530ae42 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:03.582575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 629/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:31:03.590654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b60c46-42d2-41aa-9863-503e09ad05ee None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:03.619443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:03.701867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b60c46-42d2-41aa-9863-503e09ad05ee None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:03.741880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc51a39-8785-4829-bdfd-365f342e381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:03.742503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51a39-8785-4829-bdfd-365f342e381c None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:03.742790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51a39-8785-4829-bdfd-365f342e381c None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:03.743093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51a39-8785-4829-bdfd-365f342e381c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:03.743901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51a39-8785-4829-bdfd-365f342e381c None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=642faef2d1654874bd7205420512998a, user.id=a5c20a5a655b43d1899bf2319647a894) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:03.744407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51a39-8785-4829-bdfd-365f342e381c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:03.750936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51a39-8785-4829-bdfd-365f342e381c None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:03.752201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 631/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:31:03 2022] GET /identity/v3/role_assignments?user.id=a5c20a5a655b43d1899bf2319647a894&scope.project.id=642faef2d1654874bd7205420512998a&role.id=c1429555635349208e8b2bd908436746 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:05.860446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fc00-52f5-4f36-8a4a-f0d0bb33f0a2 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:05.860976 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fc00-52f5-4f36-8a4a-f0d0bb33f0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:05.860976 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fc00-52f5-4f36-8a4a-f0d0bb33f0a2 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:05.862357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 630/1261] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:31:05.867421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5efe-a124-4e63-a463-de4ee94600e3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:05.867805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5efe-a124-4e63-a463-de4ee94600e3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:05.867968 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5efe-a124-4e63-a463-de4ee94600e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:05.886908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e4ea5efe-a124-4e63-a463-de4ee94600e3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:31:05.888110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e4ea5efe-a124-4e63-a463-de4ee94600e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:31:05.959875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 632/1262] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:31:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:31:05.981996 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185fc00-52f5-4f36-8a4a-f0d0bb33f0a2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:05.993161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:06.088088 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185fc00-52f5-4f36-8a4a-f0d0bb33f0a2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:06.123908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77593c85-b7ea-4399-afc5-ed5da0c1b404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:06.124558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77593c85-b7ea-4399-afc5-ed5da0c1b404 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:06.124837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77593c85-b7ea-4399-afc5-ed5da0c1b404 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:06.125108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77593c85-b7ea-4399-afc5-ed5da0c1b404 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:06.136477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77593c85-b7ea-4399-afc5-ed5da0c1b404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-77593c85-b7ea-4399-afc5-ed5da0c1b404 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:31:06.141551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:06.142539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:06.143434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 631/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:06.148833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5efe-a124-4e63-a463-de4ee94600e3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:06.168177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:06.251180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5efe-a124-4e63-a463-de4ee94600e3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:06.286423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eea2a-138e-4c03-b416-6064a8db6ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:06.287059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eea2a-138e-4c03-b416-6064a8db6ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:06.287334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eea2a-138e-4c03-b416-6064a8db6ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:06.287602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eea2a-138e-4c03-b416-6064a8db6ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:06.288304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eea2a-138e-4c03-b416-6064a8db6ac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:06.288600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eea2a-138e-4c03-b416-6064a8db6ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:06.289946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eea2a-138e-4c03-b416-6064a8db6ac1 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:06.298439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 633/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:31:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:06.304545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77593c85-b7ea-4399-afc5-ed5da0c1b404 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:06.370264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:06.402420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77593c85-b7ea-4399-afc5-ed5da0c1b404 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:06.437118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ea16-c068-4236-bfe5-d7e9a356409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:06.437744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ea16-c068-4236-bfe5-d7e9a356409f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:06.438018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ea16-c068-4236-bfe5-d7e9a356409f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:06.438347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ea16-c068-4236-bfe5-d7e9a356409f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:06.449556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ea16-c068-4236-bfe5-d7e9a356409f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:06.451029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ea16-c068-4236-bfe5-d7e9a356409f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-7733ea16-c068-4236-bfe5-d7e9a356409f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:31:06.465430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:06.466475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:06.467792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:31:06.467792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:31:06.467792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:06.467792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:06.467792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 632/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:06.473050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eea2a-138e-4c03-b416-6064a8db6ac1 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:06.554423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:06.572917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eea2a-138e-4c03-b416-6064a8db6ac1 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:06.605482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9dd20-3415-49f7-b6b9-b772998cc7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:06.606087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9dd20-3415-49f7-b6b9-b772998cc7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:06.606363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9dd20-3415-49f7-b6b9-b772998cc7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:06.606631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9dd20-3415-49f7-b6b9-b772998cc7d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:06.607328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9dd20-3415-49f7-b6b9-b772998cc7d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:06.607623 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9dd20-3415-49f7-b6b9-b772998cc7d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:06.608964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9dd20-3415-49f7-b6b9-b772998cc7d2 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:06.620230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 634/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:06.626070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ea16-c068-4236-bfe5-d7e9a356409f None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:06.724104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ea16-c068-4236-bfe5-d7e9a356409f None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:06.743687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:06.757891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010472b-ea8f-479d-8aa5-30eaf9c4b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:06.758223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010472b-ea8f-479d-8aa5-30eaf9c4b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:06.758496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010472b-ea8f-479d-8aa5-30eaf9c4b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:06.758775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010472b-ea8f-479d-8aa5-30eaf9c4b6d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:06.766337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010472b-ea8f-479d-8aa5-30eaf9c4b6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:06.767782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010472b-ea8f-479d-8aa5-30eaf9c4b6d5 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-1010472b-ea8f-479d-8aa5-30eaf9c4b6d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:31:06.779125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:06.780225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:06.781192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 633/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:31:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:06.786050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9dd20-3415-49f7-b6b9-b772998cc7d2 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:06.886410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9dd20-3415-49f7-b6b9-b772998cc7d2 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:06.920882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457feb2-ffe7-43d1-9205-b32e1634a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:06.921758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457feb2-ffe7-43d1-9205-b32e1634a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:06.922047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457feb2-ffe7-43d1-9205-b32e1634a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:06.922317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457feb2-ffe7-43d1-9205-b32e1634a1f8 None admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:06.923140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457feb2-ffe7-43d1-9205-b32e1634a1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:06.923451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457feb2-ffe7-43d1-9205-b32e1634a1f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:06.924876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457feb2-ffe7-43d1-9205-b32e1634a1f8 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:06.933680 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:06.942624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 635/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Aug 4 04:31:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:06.948982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010472b-ea8f-479d-8aa5-30eaf9c4b6d5 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:07.053347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010472b-ea8f-479d-8aa5-30eaf9c4b6d5 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:07.089684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c94a-a4a1-4bc1-bdca-f2439277bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:07.090327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c94a-a4a1-4bc1-bdca-f2439277bb54 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:07.090609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c94a-a4a1-4bc1-bdca-f2439277bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:07.090885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c94a-a4a1-4bc1-bdca-f2439277bb54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:07.101634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7c94a-a4a1-4bc1-bdca-f2439277bb54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:07.103151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7c94a-a4a1-4bc1-bdca-f2439277bb54 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-c8f7c94a-a4a1-4bc1-bdca-f2439277bb54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:31:07.117396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:07.118527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:07.119530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:31:07.119530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:31:07.119530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:07.119530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:07.119530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 634/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:07.124398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457feb2-ffe7-43d1-9205-b32e1634a1f8 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:07.223527 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457feb2-ffe7-43d1-9205-b32e1634a1f8 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:07.257239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef57d7e-3c6f-42bb-8030-84a078b5bb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:07.257848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef57d7e-3c6f-42bb-8030-84a078b5bb91 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:07.258131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef57d7e-3c6f-42bb-8030-84a078b5bb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:07.258407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef57d7e-3c6f-42bb-8030-84a078b5bb91 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:07.259154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef57d7e-3c6f-42bb-8030-84a078b5bb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:07.259457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef57d7e-3c6f-42bb-8030-84a078b5bb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:07.260814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef57d7e-3c6f-42bb-8030-84a078b5bb91 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:07.271790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 636/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:07.278103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c94a-a4a1-4bc1-bdca-f2439277bb54 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:07.309419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:07.379297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c94a-a4a1-4bc1-bdca-f2439277bb54 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:07.427849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc38de-b14a-45ff-a00a-78f1f055e3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:07.428730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc38de-b14a-45ff-a00a-78f1f055e3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:07.429193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc38de-b14a-45ff-a00a-78f1f055e3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:07.429428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc38de-b14a-45ff-a00a-78f1f055e3b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:07.438031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc38de-b14a-45ff-a00a-78f1f055e3b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:07.439655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc38de-b14a-45ff-a00a-78f1f055e3b9 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-9fcc38de-b14a-45ff-a00a-78f1f055e3b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:31:07.454812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:07.456191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:07.457437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:31:07.457437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:31:07.457437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:31:07.457437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:31:07.457437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:31:07.457437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:31:07.457437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:31:07.457437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:07.457437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 635/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:07.463088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef57d7e-3c6f-42bb-8030-84a078b5bb91 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:07.529790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:07.572972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef57d7e-3c6f-42bb-8030-84a078b5bb91 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:07.606590 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950f264-ec5c-4c0d-be40-90d40b8e3432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:07.607224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950f264-ec5c-4c0d-be40-90d40b8e3432 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:07.607503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950f264-ec5c-4c0d-be40-90d40b8e3432 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:07.607770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950f264-ec5c-4c0d-be40-90d40b8e3432 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:07.608511 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950f264-ec5c-4c0d-be40-90d40b8e3432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:07.608810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950f264-ec5c-4c0d-be40-90d40b8e3432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:07.610222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950f264-ec5c-4c0d-be40-90d40b8e3432 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:07.622545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 637/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:07.628732 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc38de-b14a-45ff-a00a-78f1f055e3b9 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:07.721250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:07.730320 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc38de-b14a-45ff-a00a-78f1f055e3b9 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:07.763545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b4ac-b38e-43eb-8c76-037363fb7e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:07.764209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b4ac-b38e-43eb-8c76-037363fb7e02 None admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:07.764489 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b4ac-b38e-43eb-8c76-037363fb7e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:07.764762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b4ac-b38e-43eb-8c76-037363fb7e02 None admin] PATH_INFO: `/v3/projects/642faef2d1654874bd7205420512998a/users/a5c20a5a655b43d1899bf2319647a894/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:07.766670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b4ac-b38e-43eb-8c76-037363fb7e02 None admin] RBAC: Authorizing `identity:create_grant(project_id=642faef2d1654874bd7205420512998a, user_id=a5c20a5a655b43d1899bf2319647a894, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:07.768127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b4ac-b38e-43eb-8c76-037363fb7e02 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:07.783834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 636/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Aug 4 04:31:07 2022] PUT /identity/v3/projects/642faef2d1654874bd7205420512998a/users/a5c20a5a655b43d1899bf2319647a894/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:31:09.763670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ec00c-f46e-4a63-82f0-e1a8ec8e552f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:09.764059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ec00c-f46e-4a63-82f0-e1a8ec8e552f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:09.764214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ec00c-f46e-4a63-82f0-e1a8ec8e552f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:09.765555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 638/1274] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:31:09.770646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58535872-1335-4b36-8e36-15e64ae6b295 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:09.771024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58535872-1335-4b36-8e36-15e64ae6b295 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:09.771225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58535872-1335-4b36-8e36-15e64ae6b295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:09.789156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-58535872-1335-4b36-8e36-15e64ae6b295 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:31:09.790971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-58535872-1335-4b36-8e36-15e64ae6b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:31:09.857327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 637/1275] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:31:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:31:09.880979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ec00c-f46e-4a63-82f0-e1a8ec8e552f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:09.978710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ec00c-f46e-4a63-82f0-e1a8ec8e552f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:09.994883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:10.012005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ccf07-0f0e-49e9-8dd2-cd26d13fa465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:10.012569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ccf07-0f0e-49e9-8dd2-cd26d13fa465 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:10.012841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ccf07-0f0e-49e9-8dd2-cd26d13fa465 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:10.013105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ccf07-0f0e-49e9-8dd2-cd26d13fa465 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:10.022910 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ccf07-0f0e-49e9-8dd2-cd26d13fa465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-ba7ccf07-0f0e-49e9-8dd2-cd26d13fa465 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 04:31:10.028400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:10.029620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:10.030904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 639/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Aug 4 04:31:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:10.035501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58535872-1335-4b36-8e36-15e64ae6b295 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:10.113585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:10.133365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58535872-1335-4b36-8e36-15e64ae6b295 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:10.167291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df4541-a9c9-4472-a0d6-00273013ecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:10.167901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df4541-a9c9-4472-a0d6-00273013ecda None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:10.168182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df4541-a9c9-4472-a0d6-00273013ecda None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:10.168453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df4541-a9c9-4472-a0d6-00273013ecda None admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:10.169158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df4541-a9c9-4472-a0d6-00273013ecda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:10.169461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df4541-a9c9-4472-a0d6-00273013ecda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:10.170812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df4541-a9c9-4472-a0d6-00273013ecda None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:10.178869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 638/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Aug 4 04:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:10.184582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ccf07-0f0e-49e9-8dd2-cd26d13fa465 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:10.281159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ccf07-0f0e-49e9-8dd2-cd26d13fa465 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:10.313759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556c515-3ce8-4d92-b859-d4847c692cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:10.314381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556c515-3ce8-4d92-b859-d4847c692cca None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:10.314658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556c515-3ce8-4d92-b859-d4847c692cca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:10.314927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556c515-3ce8-4d92-b859-d4847c692cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:10.325566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556c515-3ce8-4d92-b859-d4847c692cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:10.327010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556c515-3ce8-4d92-b859-d4847c692cca None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-f556c515-3ce8-4d92-b859-d4847c692cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:31:10.340670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:10.341713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:10.342814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:31:10.342814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:31:10.342814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:10.342814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:10.342814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 640/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:10.347474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df4541-a9c9-4472-a0d6-00273013ecda None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:10.449127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df4541-a9c9-4472-a0d6-00273013ecda None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:10.485934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6894-54ad-48de-a8fb-b5cf8caab544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:10.486550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6894-54ad-48de-a8fb-b5cf8caab544 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:10.486829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6894-54ad-48de-a8fb-b5cf8caab544 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:10.487153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6894-54ad-48de-a8fb-b5cf8caab544 None admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:10.487938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6894-54ad-48de-a8fb-b5cf8caab544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:10.488354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6894-54ad-48de-a8fb-b5cf8caab544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:10.489645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6894-54ad-48de-a8fb-b5cf8caab544 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:10.501641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 639/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:10.507494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556c515-3ce8-4d92-b859-d4847c692cca None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:10.537733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:10.608299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556c515-3ce8-4d92-b859-d4847c692cca None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:10.646103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e927715-dafb-4517-b389-f16d094754ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:10.646728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e927715-dafb-4517-b389-f16d094754ca None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:10.647027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e927715-dafb-4517-b389-f16d094754ca None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:10.647303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e927715-dafb-4517-b389-f16d094754ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:10.655275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e927715-dafb-4517-b389-f16d094754ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:10.656695 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e927715-dafb-4517-b389-f16d094754ca None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-3e927715-dafb-4517-b389-f16d094754ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 04:31:10.667943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:10.668918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:10.669924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 641/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:31:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:10.675310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6894-54ad-48de-a8fb-b5cf8caab544 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:10.679029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:10.772973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6894-54ad-48de-a8fb-b5cf8caab544 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:10.806289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d2d36-2f5e-4024-8aa2-df02a54b2bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:10.806807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2d36-2f5e-4024-8aa2-df02a54b2bda None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:10.807113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2d36-2f5e-4024-8aa2-df02a54b2bda None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:10.807385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d2d36-2f5e-4024-8aa2-df02a54b2bda None admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:10.808166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d2d36-2f5e-4024-8aa2-df02a54b2bda None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:10.808466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d2d36-2f5e-4024-8aa2-df02a54b2bda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:10.809877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d2d36-2f5e-4024-8aa2-df02a54b2bda None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:10.827632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 640/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Aug 4 04:31:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:10.834503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e927715-dafb-4517-b389-f16d094754ca None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:10.925101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:10.935335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e927715-dafb-4517-b389-f16d094754ca None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:10.968806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfccc-5db6-4aa3-acb2-4175c3d2e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:10.969414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfccc-5db6-4aa3-acb2-4175c3d2e34b None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:10.969697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfccc-5db6-4aa3-acb2-4175c3d2e34b None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:10.969967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfccc-5db6-4aa3-acb2-4175c3d2e34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:11.037422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfccc-5db6-4aa3-acb2-4175c3d2e34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:11.038861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfccc-5db6-4aa3-acb2-4175c3d2e34b None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:11.127203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:11.138618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 642/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Aug 4 04:31:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 04:31:11.144827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d2d36-2f5e-4024-8aa2-df02a54b2bda None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:11.221100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:11.260824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d2d36-2f5e-4024-8aa2-df02a54b2bda None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:11.295037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1d344-e61b-4fce-9cb0-f05e07b194a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:11.295675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1d344-e61b-4fce-9cb0-f05e07b194a7 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:11.295950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1d344-e61b-4fce-9cb0-f05e07b194a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:11.296216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1d344-e61b-4fce-9cb0-f05e07b194a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:11.306851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1d344-e61b-4fce-9cb0-f05e07b194a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:11.308324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1d344-e61b-4fce-9cb0-f05e07b194a7 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-f6a1d344-e61b-4fce-9cb0-f05e07b194a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 04:31:11.323103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:11.324424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:11.325765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 04:31:11.325765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 04:31:11.325765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 04:31:11.325765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:11.325765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 641/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:11.330148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfccc-5db6-4aa3-acb2-4175c3d2e34b None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:11.438103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfccc-5db6-4aa3-acb2-4175c3d2e34b None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:11.472333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19415ea2-ac26-44dc-a426-57ca57842e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:11.472954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19415ea2-ac26-44dc-a426-57ca57842e25 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:11.473233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19415ea2-ac26-44dc-a426-57ca57842e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:11.473503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19415ea2-ac26-44dc-a426-57ca57842e25 None admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:11.474196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19415ea2-ac26-44dc-a426-57ca57842e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:11.474498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19415ea2-ac26-44dc-a426-57ca57842e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:11.475964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19415ea2-ac26-44dc-a426-57ca57842e25 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:11.488041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 643/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Aug 4 04:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:11.494410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1d344-e61b-4fce-9cb0-f05e07b194a7 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:11.609722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1d344-e61b-4fce-9cb0-f05e07b194a7 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:11.624377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:11.645038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e1fe1-5338-4c70-9046-bda6c37b7d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:11.645677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e1fe1-5338-4c70-9046-bda6c37b7d15 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:11.645957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e1fe1-5338-4c70-9046-bda6c37b7d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:11.646228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e1fe1-5338-4c70-9046-bda6c37b7d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:11.653012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e1fe1-5338-4c70-9046-bda6c37b7d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:11.654456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e1fe1-5338-4c70-9046-bda6c37b7d15 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application [None req-852e1fe1-5338-4c70-9046-bda6c37b7d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 04:31:11.666368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:11.667296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:11.668195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 04:31:11.668195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 04:31:11.668195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 04:31:11.668195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 04:31:11.668195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 04:31:11.668195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 04:31:11.668195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 04:31:11.668195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: ERROR keystone.server.flask.application Aug 04 04:31:11.668195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 642/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Aug 4 04:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:11.673747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19415ea2-ac26-44dc-a426-57ca57842e25 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:11.724339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:11.776303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19415ea2-ac26-44dc-a426-57ca57842e25 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:11.808904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec54ed7-0da0-47fb-ae98-ac428c07b271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:11.809507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec54ed7-0da0-47fb-ae98-ac428c07b271 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:11.809779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec54ed7-0da0-47fb-ae98-ac428c07b271 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:11.810045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec54ed7-0da0-47fb-ae98-ac428c07b271 None admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:11.810777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec54ed7-0da0-47fb-ae98-ac428c07b271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:11.811102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec54ed7-0da0-47fb-ae98-ac428c07b271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:11.812542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec54ed7-0da0-47fb-ae98-ac428c07b271 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:11.824098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 644/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Aug 4 04:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:11.830188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e1fe1-5338-4c70-9046-bda6c37b7d15 None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:11.929863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e1fe1-5338-4c70-9046-bda6c37b7d15 None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:11.962502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e63ec8-3236-45f2-b4ff-36cee1c35e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:11.963169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e63ec8-3236-45f2-b4ff-36cee1c35e7f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:11.963448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e63ec8-3236-45f2-b4ff-36cee1c35e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:11.963716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e63ec8-3236-45f2-b4ff-36cee1c35e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:11.964492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e63ec8-3236-45f2-b4ff-36cee1c35e7f None admin] RBAC: Adding query filter params (role.id=c1429555635349208e8b2bd908436746, scope.project.id=642faef2d1654874bd7205420512998a, user.id=a5c20a5a655b43d1899bf2319647a894) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:11.964798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e63ec8-3236-45f2-b4ff-36cee1c35e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:11.966204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e63ec8-3236-45f2-b4ff-36cee1c35e7f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:11.972056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 643/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Aug 4 04:31:11 2022] GET /identity/v3/role_assignments?user.id=a5c20a5a655b43d1899bf2319647a894&scope.project.id=642faef2d1654874bd7205420512998a&role.id=c1429555635349208e8b2bd908436746 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:14.002239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18c3b7-5bae-4af2-b1bc-e103895bbf57 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:14.002797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18c3b7-5bae-4af2-b1bc-e103895bbf57 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:14.002797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18c3b7-5bae-4af2-b1bc-e103895bbf57 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:14.004164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 645/1288] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:31:14.009914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366e5a3-5c90-476e-9a43-cf5e85846526 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:14.010306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366e5a3-5c90-476e-9a43-cf5e85846526 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:14.010408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366e5a3-5c90-476e-9a43-cf5e85846526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:14.029058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7366e5a3-5c90-476e-9a43-cf5e85846526 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:31:14.030230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7366e5a3-5c90-476e-9a43-cf5e85846526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:31:14.059815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:14.097035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 644/1289] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:31:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:31:14.118974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18c3b7-5bae-4af2-b1bc-e103895bbf57 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:14.217804 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18c3b7-5bae-4af2-b1bc-e103895bbf57 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:14.228584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:14.251393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a05241-345a-4c5a-9f33-0787bc9c2962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:14.252011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a05241-345a-4c5a-9f33-0787bc9c2962 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:14.252288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a05241-345a-4c5a-9f33-0787bc9c2962 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:14.252559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a05241-345a-4c5a-9f33-0787bc9c2962 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:14.253177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a05241-345a-4c5a-9f33-0787bc9c2962 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:14.254528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a05241-345a-4c5a-9f33-0787bc9c2962 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-68a05241-345a-4c5a-9f33-0787bc9c2962 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:14.263410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:14.264618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:14.265687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 646/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:31:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:14.270454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366e5a3-5c90-476e-9a43-cf5e85846526 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:14.369498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366e5a3-5c90-476e-9a43-cf5e85846526 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:14.403642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788922ed-3da1-428d-bc8d-c3a6f2e75895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:14.404255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788922ed-3da1-428d-bc8d-c3a6f2e75895 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:14.404534 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788922ed-3da1-428d-bc8d-c3a6f2e75895 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:14.404805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788922ed-3da1-428d-bc8d-c3a6f2e75895 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:14.405468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788922ed-3da1-428d-bc8d-c3a6f2e75895 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:14.405769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788922ed-3da1-428d-bc8d-c3a6f2e75895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:14.407142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788922ed-3da1-428d-bc8d-c3a6f2e75895 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:14.412740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 645/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Aug 4 04:31:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:14.418678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a05241-345a-4c5a-9f33-0787bc9c2962 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:14.532310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a05241-345a-4c5a-9f33-0787bc9c2962 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:14.565365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4948a-afe2-4efb-8ab9-4585d9532681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:14.566025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4948a-afe2-4efb-8ab9-4585d9532681 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:14.566322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4948a-afe2-4efb-8ab9-4585d9532681 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:14.566616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4948a-afe2-4efb-8ab9-4585d9532681 None admin] PATH_INFO: `/v3/services` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:14.567346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4948a-afe2-4efb-8ab9-4585d9532681 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:14.567650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4948a-afe2-4efb-8ab9-4585d9532681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:14.569052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4948a-afe2-4efb-8ab9-4585d9532681 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:14.574203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 647/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Aug 4 04:31:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:16.603285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6df56-e33c-45f3-a117-8959442a7a66 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:16.603864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6df56-e33c-45f3-a117-8959442a7a66 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:16.603864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6df56-e33c-45f3-a117-8959442a7a66 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:16.605199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 646/1293] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:31:16.610756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11100d7-5d9a-4e4f-ae76-5b992ee2b153 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:16.611249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11100d7-5d9a-4e4f-ae76-5b992ee2b153 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:16.611348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11100d7-5d9a-4e4f-ae76-5b992ee2b153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:16.630191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d11100d7-5d9a-4e4f-ae76-5b992ee2b153 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:31:16.631451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d11100d7-5d9a-4e4f-ae76-5b992ee2b153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:31:16.661600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:16.700940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 648/1294] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:31:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 04:31:16.723317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6df56-e33c-45f3-a117-8959442a7a66 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:16.756393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:16.829868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6df56-e33c-45f3-a117-8959442a7a66 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:16.863675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63711ef-0dc4-4cf9-b93a-b551b5975e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:16.864216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63711ef-0dc4-4cf9-b93a-b551b5975e43 None admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:16.864504 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63711ef-0dc4-4cf9-b93a-b551b5975e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:16.864756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63711ef-0dc4-4cf9-b93a-b551b5975e43 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:16.865451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63711ef-0dc4-4cf9-b93a-b551b5975e43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:16.866798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63711ef-0dc4-4cf9-b93a-b551b5975e43 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:16.885307 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 647/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Aug 4 04:31:16 2022] POST /identity/v3/services => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:31:18.870915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a81c9b-a930-40dd-a0a2-86b2179f1a84 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:18.871456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a81c9b-a930-40dd-a0a2-86b2179f1a84 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:18.871570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a81c9b-a930-40dd-a0a2-86b2179f1a84 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:18.872852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 649/1296] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:31:18.877793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727dc44-5536-4fa3-8b0f-4d7883688c09 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:18.878177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727dc44-5536-4fa3-8b0f-4d7883688c09 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:18.878332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727dc44-5536-4fa3-8b0f-4d7883688c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:18.896302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4727dc44-5536-4fa3-8b0f-4d7883688c09 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:31:18.897452 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4727dc44-5536-4fa3-8b0f-4d7883688c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:31:18.978376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 648/1297] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:31:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:31:19.002287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a81c9b-a930-40dd-a0a2-86b2179f1a84 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:19.103838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a81c9b-a930-40dd-a0a2-86b2179f1a84 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:19.136208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1dc22-4127-44fa-a71b-034037708928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:19.136824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1dc22-4127-44fa-a71b-034037708928 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:19.137097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1dc22-4127-44fa-a71b-034037708928 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:19.137363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1dc22-4127-44fa-a71b-034037708928 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:19.137971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1dc22-4127-44fa-a71b-034037708928 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:19.139337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1dc22-4127-44fa-a71b-034037708928 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-43d1dc22-4127-44fa-a71b-034037708928 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:19.147849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:19.149688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:19.150878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 650/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:31:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:19.155620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727dc44-5536-4fa3-8b0f-4d7883688c09 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:19.173624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:19.254043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727dc44-5536-4fa3-8b0f-4d7883688c09 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:19.287855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebe9d5-1008-405f-a7ce-f2a1737891bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:19.288465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebe9d5-1008-405f-a7ce-f2a1737891bb None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:19.288828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebe9d5-1008-405f-a7ce-f2a1737891bb None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:19.289115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebe9d5-1008-405f-a7ce-f2a1737891bb None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:19.290365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebe9d5-1008-405f-a7ce-f2a1737891bb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:19.290674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebe9d5-1008-405f-a7ce-f2a1737891bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:19.292067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebe9d5-1008-405f-a7ce-f2a1737891bb None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:19.297484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 649/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Aug 4 04:31:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:19.303741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1dc22-4127-44fa-a71b-034037708928 None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:19.343250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:19.413549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1dc22-4127-44fa-a71b-034037708928 None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:19.455308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21513d-9dd2-40cc-a0b3-0d6b554ab642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:19.456049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21513d-9dd2-40cc-a0b3-0d6b554ab642 None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:19.456255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21513d-9dd2-40cc-a0b3-0d6b554ab642 None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:19.456626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21513d-9dd2-40cc-a0b3-0d6b554ab642 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:19.457428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21513d-9dd2-40cc-a0b3-0d6b554ab642 None admin] RBAC: Adding query filter params (interface=public, service_id=d3297902fbe04801ac96304f518fc952, region_id=RegionOne) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:19.457751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21513d-9dd2-40cc-a0b3-0d6b554ab642 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:19.459327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21513d-9dd2-40cc-a0b3-0d6b554ab642 None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:19.465735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 651/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Aug 4 04:31:19 2022] GET /identity/v3/endpoints?service_id=d3297902fbe04801ac96304f518fc952&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:19.474731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebe9d5-1008-405f-a7ce-f2a1737891bb None admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:19.574089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:19.593449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebe9d5-1008-405f-a7ce-f2a1737891bb None admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:19.627809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143818c8-378a-413e-a468-d9b70b7b934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:19.628427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143818c8-378a-413e-a468-d9b70b7b934f None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:19.628706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143818c8-378a-413e-a468-d9b70b7b934f None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:19.628978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143818c8-378a-413e-a468-d9b70b7b934f None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:19.629629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143818c8-378a-413e-a468-d9b70b7b934f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:19.631012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143818c8-378a-413e-a468-d9b70b7b934f None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:19.639720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 650/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Aug 4 04:31:19 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:31:21.659728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73846b-153f-478e-93b2-8062bbeec617 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:21.660395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73846b-153f-478e-93b2-8062bbeec617 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:21.660862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73846b-153f-478e-93b2-8062bbeec617 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:21.662754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 652/1302] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:31:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:31:21.668927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eda62-aa7e-4a15-a3d0-b4fe09a8ba17 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:21.669368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eda62-aa7e-4a15-a3d0-b4fe09a8ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:21.669482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eda62-aa7e-4a15-a3d0-b4fe09a8ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:21.688478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f46eda62-aa7e-4a15-a3d0-b4fe09a8ba17 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:31:21.689675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f46eda62-aa7e-4a15-a3d0-b4fe09a8ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:31:21.763185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 651/1303] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:31:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 04:31:21.786449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73846b-153f-478e-93b2-8062bbeec617 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:21.886495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:21.893851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73846b-153f-478e-93b2-8062bbeec617 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:21.927330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc50b-4e86-4129-993a-cc4469c2765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:21.927884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc50b-4e86-4129-993a-cc4469c2765f None admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:21.928160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc50b-4e86-4129-993a-cc4469c2765f None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:21.928428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc50b-4e86-4129-993a-cc4469c2765f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:21.929055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdc50b-4e86-4129-993a-cc4469c2765f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:21.930798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdc50b-4e86-4129-993a-cc4469c2765f None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application [None req-36fdc50b-4e86-4129-993a-cc4469c2765f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 04:31:21.940355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 04:31:21.941597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application with Lock( Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self._enter() Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application return self.creator() Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application created_value = creator( Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: ERROR keystone.server.flask.application Aug 04 04:31:21.942446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 653/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Aug 4 04:31:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 04:31:21.948246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eda62-aa7e-4a15-a3d0-b4fe09a8ba17 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:22.032565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:22.055399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eda62-aa7e-4a15-a3d0-b4fe09a8ba17 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:22.090036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38aabd-f268-4cf8-aa1b-d1183af73437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:22.090643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38aabd-f268-4cf8-aa1b-d1183af73437 None admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:22.090924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38aabd-f268-4cf8-aa1b-d1183af73437 None admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:22.091227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38aabd-f268-4cf8-aa1b-d1183af73437 None admin] PATH_INFO: `/v3/services` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:22.091897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38aabd-f268-4cf8-aa1b-d1183af73437 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:31:22.092197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38aabd-f268-4cf8-aa1b-d1183af73437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:22.093550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38aabd-f268-4cf8-aa1b-d1183af73437 None admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:22.098563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 652/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Aug 4 04:31:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:31:22.104520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc50b-4e86-4129-993a-cc4469c2765f None admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:31:22.199362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc50b-4e86-4129-993a-cc4469c2765f None admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:31:22.232055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81409e-d14f-48a2-8bf5-bd6ffde2ce7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:31:22.232646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81409e-d14f-48a2-8bf5-bd6ffde2ce7a None admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:31:22.232920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81409e-d14f-48a2-8bf5-bd6ffde2ce7a None admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:31:22.233187 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81409e-d14f-48a2-8bf5-bd6ffde2ce7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:31:22.233867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81409e-d14f-48a2-8bf5-bd6ffde2ce7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:31:22.235238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81409e-d14f-48a2-8bf5-bd6ffde2ce7a None admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:31:22.254458 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 654/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:31:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:31:32.096042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=30 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:31:32.250868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:25.535017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aefbd-663a-46cf-9a05-b63bf4fcef7b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:25.535621 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aefbd-663a-46cf-9a05-b63bf4fcef7b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:25.535621 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8aefbd-663a-46cf-9a05-b63bf4fcef7b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:25.537027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 653/1307] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:25.542429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb376211-50b9-48e2-9e8e-a2f388367bc3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:25.543315 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb376211-50b9-48e2-9e8e-a2f388367bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:25.543817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb376211-50b9-48e2-9e8e-a2f388367bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:25.702875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fb376211-50b9-48e2-9e8e-a2f388367bc3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:25.706103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fb376211-50b9-48e2-9e8e-a2f388367bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:25.901553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 655/1308] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:25.951213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de80887-eac5-4864-a028-5efd85e5c56a None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:25.951519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de80887-eac5-4864-a028-5efd85e5c56a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:25.951930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de80887-eac5-4864-a028-5efd85e5c56a None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:25.953695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 654/1309] 10.222.0.57 () {54 vars in 965 bytes} [Thu Aug 4 04:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:25.960414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aab61-1fe6-4914-8170-94a33bc7b724 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:25.961031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aab61-1fe6-4914-8170-94a33bc7b724 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:25.961503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aab61-1fe6-4914-8170-94a33bc7b724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:26.060533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1a9aab61-1fe6-4914-8170-94a33bc7b724 None None] MFA Rules not processed for user `c426cc367a1843d38978d3b8e636276e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:26.062292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1a9aab61-1fe6-4914-8170-94a33bc7b724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:26.085375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:26.148742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 656/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Aug 4 04:32:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:26.157556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de80887-eac5-4864-a028-5efd85e5c56a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:26.159339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3de80887-eac5-4864-a028-5efd85e5c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:26.291405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de80887-eac5-4864-a028-5efd85e5c56a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:26.391884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980ba5c-9cbd-4a28-802c-32cd8f91f390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:26.392904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ba5c-9cbd-4a28-802c-32cd8f91f390 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:26.393413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ba5c-9cbd-4a28-802c-32cd8f91f390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:26.394019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ba5c-9cbd-4a28-802c-32cd8f91f390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:26.396111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e980ba5c-9cbd-4a28-802c-32cd8f91f390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:26.465700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:26.530361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980ba5c-9cbd-4a28-802c-32cd8f91f390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:26.531990 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980ba5c-9cbd-4a28-802c-32cd8f91f390 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:26.555916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 655/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:28.891211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847b7a5-a8db-4bf3-ad13-7f44055fafce None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:28.891944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847b7a5-a8db-4bf3-ad13-7f44055fafce None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:28.891944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847b7a5-a8db-4bf3-ad13-7f44055fafce None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:28.893740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 657/1312] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:28.900200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167056f-7f0b-42e6-be62-9fcee3085e99 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:28.900687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167056f-7f0b-42e6-be62-9fcee3085e99 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:28.900880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167056f-7f0b-42e6-be62-9fcee3085e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:28.992771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6167056f-7f0b-42e6-be62-9fcee3085e99 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:28.994468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6167056f-7f0b-42e6-be62-9fcee3085e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:29.117373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 656/1313] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:29.157669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847b7a5-a8db-4bf3-ad13-7f44055fafce None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:29.159317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6847b7a5-a8db-4bf3-ad13-7f44055fafce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:29.294670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847b7a5-a8db-4bf3-ad13-7f44055fafce None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:29.380857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:29.383918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf19687-3b61-4289-be33-57243bb5c471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:29.384806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf19687-3b61-4289-be33-57243bb5c471 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:29.385125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf19687-3b61-4289-be33-57243bb5c471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:29.385588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf19687-3b61-4289-be33-57243bb5c471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:29.387570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1cf19687-3b61-4289-be33-57243bb5c471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:29.503550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf19687-3b61-4289-be33-57243bb5c471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:29.505034 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf19687-3b61-4289-be33-57243bb5c471 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:29.523688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 658/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:31.859190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466f59f-bbc3-43fe-ad88-6f23ee4f6286 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:31.859718 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466f59f-bbc3-43fe-ad88-6f23ee4f6286 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:31.859718 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466f59f-bbc3-43fe-ad88-6f23ee4f6286 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:31.861093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 657/1315] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:31.866854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2109b0-e2fb-481d-bf46-a892f673e81a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:31.867297 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2109b0-e2fb-481d-bf46-a892f673e81a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:31.867433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2109b0-e2fb-481d-bf46-a892f673e81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:31.931558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3d2109b0-e2fb-481d-bf46-a892f673e81a None None] MFA Rules not processed for user `ec83bbe15a0149e7887bb8e59789155b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:31.932758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3d2109b0-e2fb-481d-bf46-a892f673e81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:31.982301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:32.026264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 659/1316] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:32.081361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b694a-cfa8-4081-8f9f-6a1d1a9010ac None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:32.081640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b694a-cfa8-4081-8f9f-6a1d1a9010ac None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:32.081912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b694a-cfa8-4081-8f9f-6a1d1a9010ac None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:32.083303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 658/1317] 10.222.0.57 () {54 vars in 965 bytes} [Thu Aug 4 04:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:32.089323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9149492-d15d-4506-aab8-c6723bfb2e96 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:32.089612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9149492-d15d-4506-aab8-c6723bfb2e96 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:32.089885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9149492-d15d-4506-aab8-c6723bfb2e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:32.171679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e9149492-d15d-4506-aab8-c6723bfb2e96 None None] MFA Rules not processed for user `c426cc367a1843d38978d3b8e636276e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:32.172904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e9149492-d15d-4506-aab8-c6723bfb2e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:32.250037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 660/1318] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Aug 4 04:32:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:32.259106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b694a-cfa8-4081-8f9f-6a1d1a9010ac None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:32.260638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c23b694a-cfa8-4081-8f9f-6a1d1a9010ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:32.270415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:32.363336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b694a-cfa8-4081-8f9f-6a1d1a9010ac None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:32.436122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ae42e-affc-4c7b-92d2-07af4993249f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:32.436726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ae42e-affc-4c7b-92d2-07af4993249f service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:32.437010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ae42e-affc-4c7b-92d2-07af4993249f service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:32.437282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ae42e-affc-4c7b-92d2-07af4993249f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:32.438893 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-387ae42e-affc-4c7b-92d2-07af4993249f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:32.503159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:32.555575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ae42e-affc-4c7b-92d2-07af4993249f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:32.557001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ae42e-affc-4c7b-92d2-07af4993249f service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:32.575037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 659/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:35.539093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902b617-ccc0-4e9c-87d6-5ff8c131a95d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:35.539677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902b617-ccc0-4e9c-87d6-5ff8c131a95d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:35.539677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902b617-ccc0-4e9c-87d6-5ff8c131a95d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:35.541007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 661/1320] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:35.546960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38904e6-e5fc-460f-83b5-51f384974f6d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:35.547399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38904e6-e5fc-460f-83b5-51f384974f6d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:35.547505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38904e6-e5fc-460f-83b5-51f384974f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:35.620147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c38904e6-e5fc-460f-83b5-51f384974f6d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:35.621376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c38904e6-e5fc-460f-83b5-51f384974f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:35.716841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 660/1321] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:35.756646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902b617-ccc0-4e9c-87d6-5ff8c131a95d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:35.758175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1902b617-ccc0-4e9c-87d6-5ff8c131a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:35.807621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:35.862129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902b617-ccc0-4e9c-87d6-5ff8c131a95d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:35.938129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee19a-4c93-44c3-b53f-a520ad741f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:35.938740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee19a-4c93-44c3-b53f-a520ad741f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:35.939054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee19a-4c93-44c3-b53f-a520ad741f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:35.939327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee19a-4c93-44c3-b53f-a520ad741f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:35.940935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f97ee19a-4c93-44c3-b53f-a520ad741f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:36.037066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:36.051593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee19a-4c93-44c3-b53f-a520ad741f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:36.053026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee19a-4c93-44c3-b53f-a520ad741f53 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:36.071319 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 662/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:38.851862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d24423-e6b4-4bde-ad44-8f410e18f972 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:38.852440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d24423-e6b4-4bde-ad44-8f410e18f972 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:38.852440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d24423-e6b4-4bde-ad44-8f410e18f972 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:38.853808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 661/1323] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:38.859146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890acc21-643b-4cd6-be8e-8c716d5563fd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:38.859563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890acc21-643b-4cd6-be8e-8c716d5563fd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:38.859687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890acc21-643b-4cd6-be8e-8c716d5563fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:38.924746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-890acc21-643b-4cd6-be8e-8c716d5563fd None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:38.926524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-890acc21-643b-4cd6-be8e-8c716d5563fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:39.027652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 663/1324] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:39.065527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d24423-e6b4-4bde-ad44-8f410e18f972 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:39.067094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-26d24423-e6b4-4bde-ad44-8f410e18f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:39.086977 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:39.179962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d24423-e6b4-4bde-ad44-8f410e18f972 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:39.253703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd9492-0bc2-4ceb-8fc0-83c28b6000c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:39.254325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9492-0bc2-4ceb-8fc0-83c28b6000c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:39.254604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9492-0bc2-4ceb-8fc0-83c28b6000c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:39.255075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9492-0bc2-4ceb-8fc0-83c28b6000c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:39.256628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a6cd9492-0bc2-4ceb-8fc0-83c28b6000c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:39.334926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:39.376741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd9492-0bc2-4ceb-8fc0-83c28b6000c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:39.378176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd9492-0bc2-4ceb-8fc0-83c28b6000c7 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:39.396540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 662/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:41.487239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667ecaf-aa5d-4943-a9c9-b7ab7fc08af2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:41.488374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667ecaf-aa5d-4943-a9c9-b7ab7fc08af2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:41.488374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667ecaf-aa5d-4943-a9c9-b7ab7fc08af2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:41.489732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 664/1326] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:41.495194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc4665-ebfd-4104-86ff-11511933cb50 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:41.495614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc4665-ebfd-4104-86ff-11511933cb50 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:41.495751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc4665-ebfd-4104-86ff-11511933cb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:41.567080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-38cc4665-ebfd-4104-86ff-11511933cb50 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:41.568296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-38cc4665-ebfd-4104-86ff-11511933cb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:41.665186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 663/1327] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:41.701967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667ecaf-aa5d-4943-a9c9-b7ab7fc08af2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:41.703552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0667ecaf-aa5d-4943-a9c9-b7ab7fc08af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:41.766248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:41.809853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667ecaf-aa5d-4943-a9c9-b7ab7fc08af2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:41.885361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396c49a-ae8e-446f-b48b-0f39948b2441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:41.885991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396c49a-ae8e-446f-b48b-0f39948b2441 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:41.886265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396c49a-ae8e-446f-b48b-0f39948b2441 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:41.886542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396c49a-ae8e-446f-b48b-0f39948b2441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:41.888270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3396c49a-ae8e-446f-b48b-0f39948b2441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:42.004074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:42.006293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396c49a-ae8e-446f-b48b-0f39948b2441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:42.007859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396c49a-ae8e-446f-b48b-0f39948b2441 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:42.027118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 665/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:44.090868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65873fe-5410-4492-b660-0c891954eb24 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:44.091440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65873fe-5410-4492-b660-0c891954eb24 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:44.091440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65873fe-5410-4492-b660-0c891954eb24 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:44.092737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 664/1329] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:44.098632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0e7ba-353a-407c-b133-95607c276161 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:44.099102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0e7ba-353a-407c-b133-95607c276161 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:44.099210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0e7ba-353a-407c-b133-95607c276161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:44.164808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f1d0e7ba-353a-407c-b133-95607c276161 None None] MFA Rules not processed for user `ec83bbe15a0149e7887bb8e59789155b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:44.166010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f1d0e7ba-353a-407c-b133-95607c276161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:44.264976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 666/1330] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:44.305367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65873fe-5410-4492-b660-0c891954eb24 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:44.307049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f65873fe-5410-4492-b660-0c891954eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:44.337411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:44.412109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65873fe-5410-4492-b660-0c891954eb24 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:44.485987 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211f2d6-f06e-4b73-9e94-e41270e232e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:44.486602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211f2d6-f06e-4b73-9e94-e41270e232e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:44.486883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211f2d6-f06e-4b73-9e94-e41270e232e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:44.487187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211f2d6-f06e-4b73-9e94-e41270e232e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:44.488846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c211f2d6-f06e-4b73-9e94-e41270e232e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:44.577172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:44.610287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211f2d6-f06e-4b73-9e94-e41270e232e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:44.611756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211f2d6-f06e-4b73-9e94-e41270e232e6 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:44.629670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 665/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:46.958553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1ee85-b6ee-4434-a190-9a8d5ffaf046 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:46.959142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1ee85-b6ee-4434-a190-9a8d5ffaf046 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:46.959142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1ee85-b6ee-4434-a190-9a8d5ffaf046 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:46.960498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 667/1332] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:46.965665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3972a4-0437-4f3b-ba22-e8ea5e2d55a5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:46.966056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3972a4-0437-4f3b-ba22-e8ea5e2d55a5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:46.966220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3972a4-0437-4f3b-ba22-e8ea5e2d55a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:47.032643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-be3972a4-0437-4f3b-ba22-e8ea5e2d55a5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:47.033788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-be3972a4-0437-4f3b-ba22-e8ea5e2d55a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:47.137764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 666/1333] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:47.174642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1ee85-b6ee-4434-a190-9a8d5ffaf046 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:47.176207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1bd1ee85-b6ee-4434-a190-9a8d5ffaf046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:47.244681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:47.279425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1ee85-b6ee-4434-a190-9a8d5ffaf046 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:47.357047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc32a4c-309e-449a-9808-46efb69f3205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:47.357576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc32a4c-309e-449a-9808-46efb69f3205 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:47.357873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc32a4c-309e-449a-9808-46efb69f3205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:47.358122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc32a4c-309e-449a-9808-46efb69f3205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:47.359764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5dc32a4c-309e-449a-9808-46efb69f3205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:47.470778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc32a4c-309e-449a-9808-46efb69f3205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:47.472291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc32a4c-309e-449a-9808-46efb69f3205 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:47.482860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:47.492076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 668/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:49.565206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44dde7-cf5d-400e-8435-aa5f1ef8e2ac None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:49.566217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44dde7-cf5d-400e-8435-aa5f1ef8e2ac None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:49.566337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44dde7-cf5d-400e-8435-aa5f1ef8e2ac None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:49.567729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 667/1335] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:49.572761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a664ba1-6d0f-414e-9645-81c0b7a08bf8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:49.573197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a664ba1-6d0f-414e-9645-81c0b7a08bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:49.573301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a664ba1-6d0f-414e-9645-81c0b7a08bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:49.639719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7a664ba1-6d0f-414e-9645-81c0b7a08bf8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:49.640924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7a664ba1-6d0f-414e-9645-81c0b7a08bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:49.735840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 669/1336] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:49.776599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44dde7-cf5d-400e-8435-aa5f1ef8e2ac None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:49.778128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5b44dde7-cf5d-400e-8435-aa5f1ef8e2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:49.820007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:49.884245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44dde7-cf5d-400e-8435-aa5f1ef8e2ac None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:49.957190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18968798-8c98-4b35-b6b3-a9c435e6aa82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:49.957803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18968798-8c98-4b35-b6b3-a9c435e6aa82 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:49.958103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18968798-8c98-4b35-b6b3-a9c435e6aa82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:49.958354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18968798-8c98-4b35-b6b3-a9c435e6aa82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:49.960027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-18968798-8c98-4b35-b6b3-a9c435e6aa82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:50.043216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:50.069751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18968798-8c98-4b35-b6b3-a9c435e6aa82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:50.071213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18968798-8c98-4b35-b6b3-a9c435e6aa82 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:50.088943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 668/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:52.501159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c7ad-8055-40d4-872b-fa1bbf4fb3f1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:52.501688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c7ad-8055-40d4-872b-fa1bbf4fb3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:52.501688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c7ad-8055-40d4-872b-fa1bbf4fb3f1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:52.503604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 670/1338] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:52.509018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a730b-a6be-4129-bf84-fadf84cb0daa None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:52.509460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a730b-a6be-4129-bf84-fadf84cb0daa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:52.509568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a730b-a6be-4129-bf84-fadf84cb0daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:52.578366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b22a730b-a6be-4129-bf84-fadf84cb0daa None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:52.579595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b22a730b-a6be-4129-bf84-fadf84cb0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:52.677192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 669/1339] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:52.713053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41c7ad-8055-40d4-872b-fa1bbf4fb3f1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:52.714586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5f41c7ad-8055-40d4-872b-fa1bbf4fb3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:52.789384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:52.817255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41c7ad-8055-40d4-872b-fa1bbf4fb3f1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:52.894255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae473d-f826-4a9c-9a79-ca5c2818c694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:52.894873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae473d-f826-4a9c-9a79-ca5c2818c694 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:52.895204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae473d-f826-4a9c-9a79-ca5c2818c694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:52.895480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae473d-f826-4a9c-9a79-ca5c2818c694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:52.897162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d7ae473d-f826-4a9c-9a79-ca5c2818c694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:53.004269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae473d-f826-4a9c-9a79-ca5c2818c694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:53.005811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae473d-f826-4a9c-9a79-ca5c2818c694 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:53.024436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 671/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:32:57.015389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958140f-56af-4da0-8069-3ca8654bd447 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:57.015904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958140f-56af-4da0-8069-3ca8654bd447 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:57.015904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958140f-56af-4da0-8069-3ca8654bd447 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:57.017241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 670/1341] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:32:57.022481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2be2bb-89c7-4770-bf91-5fc69ef6c848 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:57.022962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2be2bb-89c7-4770-bf91-5fc69ef6c848 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:57.023090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2be2bb-89c7-4770-bf91-5fc69ef6c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:57.028615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:57.090305 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8e2be2bb-89c7-4770-bf91-5fc69ef6c848 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:32:57.091526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8e2be2bb-89c7-4770-bf91-5fc69ef6c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:57.189307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 672/1342] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:32:57.229962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958140f-56af-4da0-8069-3ca8654bd447 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:32:57.231551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d958140f-56af-4da0-8069-3ca8654bd447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:57.279619 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:57.338679 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958140f-56af-4da0-8069-3ca8654bd447 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:32:57.411981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e894fe5-e6fb-4c8c-aea9-62b8b88a2f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:32:57.412709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e894fe5-e6fb-4c8c-aea9-62b8b88a2f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:32:57.412998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e894fe5-e6fb-4c8c-aea9-62b8b88a2f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:32:57.413293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e894fe5-e6fb-4c8c-aea9-62b8b88a2f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:32:57.414902 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0e894fe5-e6fb-4c8c-aea9-62b8b88a2f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:32:57.512872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:32:57.530854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e894fe5-e6fb-4c8c-aea9-62b8b88a2f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:32:57.532241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e894fe5-e6fb-4c8c-aea9-62b8b88a2f58 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:32:57.552943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 671/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:00.134213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bbc03-b6e2-49ae-a479-fc215fe3f0e1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:00.134727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bbc03-b6e2-49ae-a479-fc215fe3f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:00.134727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bbc03-b6e2-49ae-a479-fc215fe3f0e1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:00.136102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 673/1344] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:00.141973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524afc57-4c3e-4ce4-95fc-f82e1607ef90 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:00.142498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524afc57-4c3e-4ce4-95fc-f82e1607ef90 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:00.142498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524afc57-4c3e-4ce4-95fc-f82e1607ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:00.214023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-524afc57-4c3e-4ce4-95fc-f82e1607ef90 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:00.215316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-524afc57-4c3e-4ce4-95fc-f82e1607ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:00.321062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 672/1345] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:33:00.357921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bbc03-b6e2-49ae-a479-fc215fe3f0e1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:00.359508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ba2bbc03-b6e2-49ae-a479-fc215fe3f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:00.452701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:00.470270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bbc03-b6e2-49ae-a479-fc215fe3f0e1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:00.542293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54264173-9b0e-43a1-9d0b-8e40c604dc69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:00.542824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54264173-9b0e-43a1-9d0b-8e40c604dc69 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:00.543143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54264173-9b0e-43a1-9d0b-8e40c604dc69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:00.543416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54264173-9b0e-43a1-9d0b-8e40c604dc69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:00.545275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-54264173-9b0e-43a1-9d0b-8e40c604dc69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:00.655007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54264173-9b0e-43a1-9d0b-8e40c604dc69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:00.656441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54264173-9b0e-43a1-9d0b-8e40c604dc69 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:00.674370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 674/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:04.774815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898c1f4-b7a8-4965-b39b-58a3a3bd3147 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:04.775337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898c1f4-b7a8-4965-b39b-58a3a3bd3147 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:04.775430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898c1f4-b7a8-4965-b39b-58a3a3bd3147 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:04.776791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 673/1347] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:04.782213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ff81-0475-42bc-adb3-554e5ef27140 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:04.782692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ff81-0475-42bc-adb3-554e5ef27140 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:04.782775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ff81-0475-42bc-adb3-554e5ef27140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:04.799730 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:04.852430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b5c3ff81-0475-42bc-adb3-554e5ef27140 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:04.853656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b5c3ff81-0475-42bc-adb3-554e5ef27140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:04.952426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 675/1348] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:04.990627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898c1f4-b7a8-4965-b39b-58a3a3bd3147 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:04.992184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a898c1f4-b7a8-4965-b39b-58a3a3bd3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:05.051223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:05.104405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898c1f4-b7a8-4965-b39b-58a3a3bd3147 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:05.201791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0210eb-08c0-4acb-8125-6dc6ca783895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:05.202405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0210eb-08c0-4acb-8125-6dc6ca783895 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:05.202731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0210eb-08c0-4acb-8125-6dc6ca783895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:05.202943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0210eb-08c0-4acb-8125-6dc6ca783895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:05.204598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8b0210eb-08c0-4acb-8125-6dc6ca783895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:05.317330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:05.321098 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0210eb-08c0-4acb-8125-6dc6ca783895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:05.323006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0210eb-08c0-4acb-8125-6dc6ca783895 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:05.342865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 674/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:10.251078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace5f92-4d20-40a6-a926-50b71f394c64 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:10.251609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace5f92-4d20-40a6-a926-50b71f394c64 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:10.251609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace5f92-4d20-40a6-a926-50b71f394c64 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:10.253837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 676/1350] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:10.259200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebb45-9c77-467e-95b9-900d57237780 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:10.259584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebb45-9c77-467e-95b9-900d57237780 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:10.259584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ebb45-9c77-467e-95b9-900d57237780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:10.416828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-816ebb45-9c77-467e-95b9-900d57237780 None None] MFA Rules not processed for user `a5c20a5a655b43d1899bf2319647a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:10.418387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-816ebb45-9c77-467e-95b9-900d57237780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:10.569212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 675/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:33:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:14.748519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42f5d-5738-4f54-8430-06c3335865dd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:14.749487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42f5d-5738-4f54-8430-06c3335865dd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:14.749918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42f5d-5738-4f54-8430-06c3335865dd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:14.751537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 677/1352] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:14.757096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0100-3d7d-47c0-9d85-0b5311a29bf9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:14.757579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0100-3d7d-47c0-9d85-0b5311a29bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:14.757670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0100-3d7d-47c0-9d85-0b5311a29bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:14.813741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:14.838451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-077a0100-3d7d-47c0-9d85-0b5311a29bf9 None None] MFA Rules not processed for user `a5c20a5a655b43d1899bf2319647a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:14.839696 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-077a0100-3d7d-47c0-9d85-0b5311a29bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:14.950575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=59 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:14.956041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 676/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:33:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:16.180521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67696728-4216-4791-adc9-7acbcad74ac9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:16.181027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67696728-4216-4791-adc9-7acbcad74ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:16.181123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67696728-4216-4791-adc9-7acbcad74ac9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:16.182403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 678/1354] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:16.187248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34745842-4813-4737-9362-fdb594b99355 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:16.187661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34745842-4813-4737-9362-fdb594b99355 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:16.187796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34745842-4813-4737-9362-fdb594b99355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:16.262670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-34745842-4813-4737-9362-fdb594b99355 None None] MFA Rules not processed for user `a5c20a5a655b43d1899bf2319647a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:16.263880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-34745842-4813-4737-9362-fdb594b99355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:16.309844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:16.377808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 677/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:33:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:19.904473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69121e-7ecd-4daa-b7b6-03b03825d7dd None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:19.905339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69121e-7ecd-4daa-b7b6-03b03825d7dd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:19.905796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69121e-7ecd-4daa-b7b6-03b03825d7dd None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:19.911089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 679/1356] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:19.913984 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718122-2314-4b1a-8b42-9be2b38c1985 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:19.914738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718122-2314-4b1a-8b42-9be2b38c1985 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:19.915228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718122-2314-4b1a-8b42-9be2b38c1985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:19.997190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e4718122-2314-4b1a-8b42-9be2b38c1985 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:19.998316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e4718122-2314-4b1a-8b42-9be2b38c1985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:20.104686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 678/1357] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:20.159398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c7391-64ae-4033-a31f-f239ad970ce3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:20.159861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c7391-64ae-4033-a31f-f239ad970ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:20.160293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c7391-64ae-4033-a31f-f239ad970ce3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:20.162066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 680/1358] 10.222.0.57 () {54 vars in 962 bytes} [Thu Aug 4 04:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:20.172074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb364d4-1c0b-4c8a-ab70-f74a1ed63553 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:20.172777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb364d4-1c0b-4c8a-ab70-f74a1ed63553 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:20.173243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb364d4-1c0b-4c8a-ab70-f74a1ed63553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:20.194688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:20.262177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3cb364d4-1c0b-4c8a-ab70-f74a1ed63553 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:20.263603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3cb364d4-1c0b-4c8a-ab70-f74a1ed63553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:20.386587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 679/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Aug 4 04:33:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:33:20.394626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c7391-64ae-4033-a31f-f239ad970ce3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:20.396159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-282c7391-64ae-4033-a31f-f239ad970ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:20.554076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c7391-64ae-4033-a31f-f239ad970ce3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:20.637132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:20.679629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0179184-5200-4eaf-bf5d-2239d0e023e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:20.680252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0179184-5200-4eaf-bf5d-2239d0e023e5 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:20.680533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0179184-5200-4eaf-bf5d-2239d0e023e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:20.680804 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0179184-5200-4eaf-bf5d-2239d0e023e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:20.682417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a0179184-5200-4eaf-bf5d-2239d0e023e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:20.780070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0179184-5200-4eaf-bf5d-2239d0e023e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:20.781961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0179184-5200-4eaf-bf5d-2239d0e023e5 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:20.806482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 681/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:23.051553 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9150d9-bce4-4f20-9a22-cfbd3d13b3e5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:23.052049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9150d9-bce4-4f20-9a22-cfbd3d13b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:23.052049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9150d9-bce4-4f20-9a22-cfbd3d13b3e5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:23.053539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 680/1361] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:23.058409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecec28-c108-42dc-89f9-3faafd129953 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:23.058831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecec28-c108-42dc-89f9-3faafd129953 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:23.059099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecec28-c108-42dc-89f9-3faafd129953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:23.130421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-85ecec28-c108-42dc-89f9-3faafd129953 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:23.131626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-85ecec28-c108-42dc-89f9-3faafd129953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:23.172850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:23.237337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 682/1362] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:23.281076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9150d9-bce4-4f20-9a22-cfbd3d13b3e5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:23.283514 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bf9150d9-bce4-4f20-9a22-cfbd3d13b3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:23.361078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:23.465468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9150d9-bce4-4f20-9a22-cfbd3d13b3e5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:23.593295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29576f-edd7-4fd2-a04b-ab433707ac51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:23.594707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29576f-edd7-4fd2-a04b-ab433707ac51 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:23.594707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29576f-edd7-4fd2-a04b-ab433707ac51 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:23.594707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29576f-edd7-4fd2-a04b-ab433707ac51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:23.595985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0f29576f-edd7-4fd2-a04b-ab433707ac51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:23.623297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:23.696782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29576f-edd7-4fd2-a04b-ab433707ac51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:23.698405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29576f-edd7-4fd2-a04b-ab433707ac51 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:23.717058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 681/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:26.074635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c5a39-4eec-42dd-8f5c-d418da11d8fc None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:26.075183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c5a39-4eec-42dd-8f5c-d418da11d8fc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:26.075286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c5a39-4eec-42dd-8f5c-d418da11d8fc None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:26.076931 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 683/1364] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:26.082696 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226acc5-e6e7-45c3-9d44-6e88965fa27d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:26.083220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226acc5-e6e7-45c3-9d44-6e88965fa27d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:26.083313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226acc5-e6e7-45c3-9d44-6e88965fa27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:26.160622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5226acc5-e6e7-45c3-9d44-6e88965fa27d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:26.161851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5226acc5-e6e7-45c3-9d44-6e88965fa27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:26.278312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:26.281860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 682/1365] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:26.330674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926761b5-b784-4073-be57-cbe7e48c303a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:26.330964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926761b5-b784-4073-be57-cbe7e48c303a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:26.331543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926761b5-b784-4073-be57-cbe7e48c303a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:26.333104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 684/1366] 10.222.0.57 () {54 vars in 962 bytes} [Thu Aug 4 04:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:26.338614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd799-4cdf-486f-a876-96ecd8519212 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:26.338899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd799-4cdf-486f-a876-96ecd8519212 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:26.339199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd799-4cdf-486f-a876-96ecd8519212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:26.421968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a61cd799-4cdf-486f-a876-96ecd8519212 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:26.423811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a61cd799-4cdf-486f-a876-96ecd8519212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:26.547687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 683/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Aug 4 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:26.555247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926761b5-b784-4073-be57-cbe7e48c303a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:26.556756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-926761b5-b784-4073-be57-cbe7e48c303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:26.713657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926761b5-b784-4073-be57-cbe7e48c303a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:26.739745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:26.843667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe85f6-6881-483f-9ffd-b76ebb67c98a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:26.844285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe85f6-6881-483f-9ffd-b76ebb67c98a service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:26.845079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe85f6-6881-483f-9ffd-b76ebb67c98a service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:26.845347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe85f6-6881-483f-9ffd-b76ebb67c98a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:26.847141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8ffe85f6-6881-483f-9ffd-b76ebb67c98a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:26.942640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe85f6-6881-483f-9ffd-b76ebb67c98a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:26.944812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe85f6-6881-483f-9ffd-b76ebb67c98a service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:26.965198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 685/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:28.076449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3afb-c071-446a-ab68-11c0c36126dc None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:28.076947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3afb-c071-446a-ab68-11c0c36126dc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:28.076947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3afb-c071-446a-ab68-11c0c36126dc None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:28.078488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 684/1369] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:28.084308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d943-ffe4-4135-8678-c54a9770c7b4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:28.085134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d943-ffe4-4135-8678-c54a9770c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:28.086156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d943-ffe4-4135-8678-c54a9770c7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:28.122042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:28.167569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-07b7d943-ffe4-4135-8678-c54a9770c7b4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:28.169027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-07b7d943-ffe4-4135-8678-c54a9770c7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:28.270149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 686/1370] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:28.623026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570782a5-f254-4d3e-aa42-9e07f3316153 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:28.623314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570782a5-f254-4d3e-aa42-9e07f3316153 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:28.623586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570782a5-f254-4d3e-aa42-9e07f3316153 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:28.625084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 685/1371] 10.222.0.57 () {54 vars in 964 bytes} [Thu Aug 4 04:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:28.630572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f885a-7237-441d-b2ac-e3291d40e9ed None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:28.630852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f885a-7237-441d-b2ac-e3291d40e9ed None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:28.631157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f885a-7237-441d-b2ac-e3291d40e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:28.712980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-377f885a-7237-441d-b2ac-e3291d40e9ed None None] MFA Rules not processed for user `7a7ad7efdc2849ca98386decbfd77879`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:28.714177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-377f885a-7237-441d-b2ac-e3291d40e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:28.774471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:28.807450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 687/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Thu Aug 4 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:28.815535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570782a5-f254-4d3e-aa42-9e07f3316153 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:28.817018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-570782a5-f254-4d3e-aa42-9e07f3316153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:28.871598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:28.932191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570782a5-f254-4d3e-aa42-9e07f3316153 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:29.008838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:29.009459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:29.009741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:29.010017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:29.011705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:29.061861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5569cda-749d-46fc-baa3-a2ff7ef77109 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:29.062490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5569cda-749d-46fc-baa3-a2ff7ef77109 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:29.062766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5569cda-749d-46fc-baa3-a2ff7ef77109 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:29.064669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 688/1373] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:33:29.070158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eae40-49e4-490a-aede-7c01aa2db2ff None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:29.070447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eae40-49e4-490a-aede-7c01aa2db2ff None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:29.070723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eae40-49e4-490a-aede-7c01aa2db2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:29.118224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:29.132473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:29.133878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:29.140827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b67eae40-49e4-490a-aede-7c01aa2db2ff None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:29.142031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b67eae40-49e4-490a-aede-7c01aa2db2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:29.152687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 686/1374] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:29.303987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 689/1375] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:33:29.341739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:29.342971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:29.462078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae61180-2ab1-44b3-a394-b32e1d429ae2 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:29.575773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:29.589121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcca24d-4889-4b52-b42b-bad10207d448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:29.589840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcca24d-4889-4b52-b42b-bad10207d448 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:29.590188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcca24d-4889-4b52-b42b-bad10207d448 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:29.590533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcca24d-4889-4b52-b42b-bad10207d448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:29.592295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3dcca24d-4889-4b52-b42b-bad10207d448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:29.684267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcca24d-4889-4b52-b42b-bad10207d448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:29.685856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcca24d-4889-4b52-b42b-bad10207d448 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:29.704901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 687/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:31.795524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9e2b1-b364-4edb-8944-e69b5849b2bf None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:31.796049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9e2b1-b364-4edb-8944-e69b5849b2bf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:31.796049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9e2b1-b364-4edb-8944-e69b5849b2bf None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:31.797395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 690/1377] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:31.802753 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaa4f2-33fd-4493-b968-e687b7f378e5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:31.803200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaa4f2-33fd-4493-b968-e687b7f378e5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:31.803340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaa4f2-33fd-4493-b968-e687b7f378e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:31.869165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-eddaa4f2-33fd-4493-b968-e687b7f378e5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:31.870362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eddaa4f2-33fd-4493-b968-e687b7f378e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:31.928434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:31.971018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 688/1378] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:32.012743 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9e2b1-b364-4edb-8944-e69b5849b2bf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:32.014236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bee9e2b1-b364-4edb-8944-e69b5849b2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:32.073578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:32.195081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9e2b1-b364-4edb-8944-e69b5849b2bf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:32.306336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18deda-5892-4e20-be89-cdb1ddf56e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:32.306836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18deda-5892-4e20-be89-cdb1ddf56e82 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:32.307158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18deda-5892-4e20-be89-cdb1ddf56e82 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:32.307425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18deda-5892-4e20-be89-cdb1ddf56e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:32.309012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5a18deda-5892-4e20-be89-cdb1ddf56e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:32.320694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:32.400265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18deda-5892-4e20-be89-cdb1ddf56e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:32.401856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18deda-5892-4e20-be89-cdb1ddf56e82 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:32.426819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 691/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:34.537595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af024-bba3-4a89-affe-738e59e54e70 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:34.538162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af024-bba3-4a89-affe-738e59e54e70 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:34.538162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41af024-bba3-4a89-affe-738e59e54e70 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:34.539698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 689/1380] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:34.544953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830910-95f1-40a2-b585-bf810ba0257a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:34.545349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830910-95f1-40a2-b585-bf810ba0257a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:34.545556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830910-95f1-40a2-b585-bf810ba0257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:34.616235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-17830910-95f1-40a2-b585-bf810ba0257a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:34.617449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17830910-95f1-40a2-b585-bf810ba0257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:34.721125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:34.744120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 692/1381] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:34.798606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41af024-bba3-4a89-affe-738e59e54e70 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:34.800166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f41af024-bba3-4a89-affe-738e59e54e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:34.955143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41af024-bba3-4a89-affe-738e59e54e70 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:35.011030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:35.087414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3dd91-d9b9-4578-9b09-2ec2b4de7df1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:35.087948 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3dd91-d9b9-4578-9b09-2ec2b4de7df1 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:35.088257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3dd91-d9b9-4578-9b09-2ec2b4de7df1 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:35.088674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3dd91-d9b9-4578-9b09-2ec2b4de7df1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:35.090297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-98b3dd91-d9b9-4578-9b09-2ec2b4de7df1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:35.185517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3dd91-d9b9-4578-9b09-2ec2b4de7df1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:35.187144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3dd91-d9b9-4578-9b09-2ec2b4de7df1 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:35.207607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 690/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:37.276806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba618-3f3d-45c8-985a-e184fb267159 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:37.277363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba618-3f3d-45c8-985a-e184fb267159 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:37.277363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba618-3f3d-45c8-985a-e184fb267159 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:37.278711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 693/1383] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:37.284163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa144312-8bbc-4f2d-832b-c9dbb44fbff7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:37.284743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa144312-8bbc-4f2d-832b-c9dbb44fbff7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:37.284743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa144312-8bbc-4f2d-832b-c9dbb44fbff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:37.363649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-aa144312-8bbc-4f2d-832b-c9dbb44fbff7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:37.365282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aa144312-8bbc-4f2d-832b-c9dbb44fbff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:37.368034 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:37.501005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 691/1384] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:33:37.542497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ba618-3f3d-45c8-985a-e184fb267159 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:37.544322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-985ba618-3f3d-45c8-985a-e184fb267159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:37.718789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ba618-3f3d-45c8-985a-e184fb267159 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:37.792980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:37.849753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c601762-b521-4cf8-9065-1e0fd4973249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:37.850373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601762-b521-4cf8-9065-1e0fd4973249 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:37.850650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601762-b521-4cf8-9065-1e0fd4973249 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:37.850919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601762-b521-4cf8-9065-1e0fd4973249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:37.852569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4c601762-b521-4cf8-9065-1e0fd4973249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:37.961178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c601762-b521-4cf8-9065-1e0fd4973249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:37.963406 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c601762-b521-4cf8-9065-1e0fd4973249 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:37.987270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 694/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:40.586967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258500d2-d128-4b37-bef2-1699a57254f8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:40.587493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258500d2-d128-4b37-bef2-1699a57254f8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:40.587716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258500d2-d128-4b37-bef2-1699a57254f8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:40.589563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 692/1386] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:40.594967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4713d1-092b-4ec7-8b60-de755bb86af8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:40.595416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4713d1-092b-4ec7-8b60-de755bb86af8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:40.595643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4713d1-092b-4ec7-8b60-de755bb86af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:40.675732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4c4713d1-092b-4ec7-8b60-de755bb86af8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:40.676934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4c4713d1-092b-4ec7-8b60-de755bb86af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:40.701826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:40.776983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 695/1387] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:40.822417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258500d2-d128-4b37-bef2-1699a57254f8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:40.824588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-258500d2-d128-4b37-bef2-1699a57254f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:40.966172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:40.983823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258500d2-d128-4b37-bef2-1699a57254f8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:41.100446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97176-c3ea-4a12-b39d-e5a363c6c3af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:41.101449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97176-c3ea-4a12-b39d-e5a363c6c3af service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:41.101796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97176-c3ea-4a12-b39d-e5a363c6c3af service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:41.102154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97176-c3ea-4a12-b39d-e5a363c6c3af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:41.104319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c3c97176-c3ea-4a12-b39d-e5a363c6c3af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:41.216326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c97176-c3ea-4a12-b39d-e5a363c6c3af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:41.217911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c97176-c3ea-4a12-b39d-e5a363c6c3af service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:41.222898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:41.237590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 693/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:43.299339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000c842-cdd1-4080-b19d-726a91dd5ba3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:43.299872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000c842-cdd1-4080-b19d-726a91dd5ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:43.299989 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000c842-cdd1-4080-b19d-726a91dd5ba3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:43.301268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 696/1389] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:43.306665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969ba8d-091c-4a44-8d88-f82dee3d5d24 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:43.307093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969ba8d-091c-4a44-8d88-f82dee3d5d24 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:43.307257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969ba8d-091c-4a44-8d88-f82dee3d5d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:43.377593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c969ba8d-091c-4a44-8d88-f82dee3d5d24 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:43.378817 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c969ba8d-091c-4a44-8d88-f82dee3d5d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:43.492175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 694/1390] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:43.535455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000c842-cdd1-4080-b19d-726a91dd5ba3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:43.536940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8000c842-cdd1-4080-b19d-726a91dd5ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:43.681738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000c842-cdd1-4080-b19d-726a91dd5ba3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:43.691307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:43.801620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25afb8c-e691-494f-8e92-63413bcf43c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:43.802237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25afb8c-e691-494f-8e92-63413bcf43c8 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:43.802505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25afb8c-e691-494f-8e92-63413bcf43c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:43.802775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25afb8c-e691-494f-8e92-63413bcf43c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:43.804422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d25afb8c-e691-494f-8e92-63413bcf43c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:43.892726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25afb8c-e691-494f-8e92-63413bcf43c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:43.894325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25afb8c-e691-494f-8e92-63413bcf43c8 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:43.912928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 697/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:44.296432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7c06-817d-4685-aece-684239ce2758 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:44.296677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7c06-817d-4685-aece-684239ce2758 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:44.296925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7c06-817d-4685-aece-684239ce2758 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:44.298550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 695/1392] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:44.303714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db782b2-9b2a-498a-84c2-6facaf3b011d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:44.304178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db782b2-9b2a-498a-84c2-6facaf3b011d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:44.304397 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db782b2-9b2a-498a-84c2-6facaf3b011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:44.320123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:44.371250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7db782b2-9b2a-498a-84c2-6facaf3b011d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:44.372444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7db782b2-9b2a-498a-84c2-6facaf3b011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:44.470817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 698/1393] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:44.526704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21610a-9656-470e-8916-f5252292f2c8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:44.527175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21610a-9656-470e-8916-f5252292f2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:44.527310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21610a-9656-470e-8916-f5252292f2c8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:44.528686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 696/1394] 10.222.0.57 () {54 vars in 966 bytes} [Thu Aug 4 04:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:44.533847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5dafd-136c-4299-a76e-7412b6f2b30c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:44.534134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5dafd-136c-4299-a76e-7412b6f2b30c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:44.534414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5dafd-136c-4299-a76e-7412b6f2b30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:44.610302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6af5dafd-136c-4299-a76e-7412b6f2b30c None None] MFA Rules not processed for user `955c6cb8893c473fadd028b12bbea69d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:44.611500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6af5dafd-136c-4299-a76e-7412b6f2b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:44.646422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:44.689424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 699/1395] 10.222.0.57 () {58 vars in 1063 bytes} [Thu Aug 4 04:33:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:44.697485 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21610a-9656-470e-8916-f5252292f2c8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:44.699005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9d21610a-9656-470e-8916-f5252292f2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:44.773394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:44.805922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21610a-9656-470e-8916-f5252292f2c8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:44.881565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09f97c-58f1-4c24-9cb6-d33dbf86cd9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955c6cb8893c473fadd028b12bbea69d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:44.882095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09f97c-58f1-4c24-9cb6-d33dbf86cd9a service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:44.882369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09f97c-58f1-4c24-9cb6-d33dbf86cd9a service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:44.882631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09f97c-58f1-4c24-9cb6-d33dbf86cd9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:44.884253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ec09f97c-58f1-4c24-9cb6-d33dbf86cd9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:44.997316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09f97c-58f1-4c24-9cb6-d33dbf86cd9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:44.999068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09f97c-58f1-4c24-9cb6-d33dbf86cd9a service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:45.015085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:45.019439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 697/1396] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:45.773657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674100-e438-42bc-b99a-f35098dee272 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:45.774152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674100-e438-42bc-b99a-f35098dee272 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:45.774354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674100-e438-42bc-b99a-f35098dee272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:45.841337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-fd674100-e438-42bc-b99a-f35098dee272 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:45.842543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fd674100-e438-42bc-b99a-f35098dee272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:45.928556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 700/1397] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:33:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:45.971285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69827f-83cc-4309-956b-db95f88c7bc8 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:45.971792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69827f-83cc-4309-956b-db95f88c7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:45.971898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69827f-83cc-4309-956b-db95f88c7bc8 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:45.972012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1e19d-2aba-4bd5-bfc3-751ada3473e8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:45.972276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1e19d-2aba-4bd5-bfc3-751ada3473e8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:45.972554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1e19d-2aba-4bd5-bfc3-751ada3473e8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:45.973254 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 698/1398] 10.222.0.57 () {54 vars in 943 bytes} [Thu Aug 4 04:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:45.973891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 701/1399] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:45.978769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e466-4ccd-4419-9e2c-8a2495a7b9c1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:45.979080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e466-4ccd-4419-9e2c-8a2495a7b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:45.979353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e466-4ccd-4419-9e2c-8a2495a7b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:45.980075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86afe2-f188-4e5a-a5b9-1d68caa2c413 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:45.980495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86afe2-f188-4e5a-a5b9-1d68caa2c413 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:45.980769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86afe2-f188-4e5a-a5b9-1d68caa2c413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:46.040224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:46.050522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1819e466-4ccd-4419-9e2c-8a2495a7b9c1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:46.051804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1819e466-4ccd-4419-9e2c-8a2495a7b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:46.061900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ae86afe2-f188-4e5a-a5b9-1d68caa2c413 None None] MFA Rules not processed for user `5dcb9d2fbde74819b3848d050299cfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:46.063195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ae86afe2-f188-4e5a-a5b9-1d68caa2c413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:46.199246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 702/1400] 10.222.0.57 () {58 vars in 1040 bytes} [Thu Aug 4 04:33:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:33:46.213009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86afe2-f188-4e5a-a5b9-1d68caa2c413 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:46.223704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86afe2-f188-4e5a-a5b9-1d68caa2c413 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:46.281069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 699/1401] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:46.324954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819e466-4ccd-4419-9e2c-8a2495a7b9c1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:46.326138 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1819e466-4ccd-4419-9e2c-8a2495a7b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:46.328483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:46.334465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7a61c-c50d-4c04-b463-c0c9442f3d93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:46.335109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7a61c-c50d-4c04-b463-c0c9442f3d93 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:46.335382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7a61c-c50d-4c04-b463-c0c9442f3d93 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:46.335648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7a61c-c50d-4c04-b463-c0c9442f3d93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:46.337269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c1c7a61c-c50d-4c04-b463-c0c9442f3d93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:46.402365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:46.423085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7a61c-c50d-4c04-b463-c0c9442f3d93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:46.424659 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7a61c-c50d-4c04-b463-c0c9442f3d93 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:46.434121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 703/1402] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:33:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 04:33:46.443323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819e466-4ccd-4419-9e2c-8a2495a7b9c1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:46.585798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dc9c2-5957-46ce-b384-545491008219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:46.586330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dc9c2-5957-46ce-b384-545491008219 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:46.586610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dc9c2-5957-46ce-b384-545491008219 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:46.586882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dc9c2-5957-46ce-b384-545491008219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:46.588532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b16dc9c2-5957-46ce-b384-545491008219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:46.666658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:46.684236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dc9c2-5957-46ce-b384-545491008219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:46.685859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dc9c2-5957-46ce-b384-545491008219 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:46.707887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 700/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:33:48.752727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0368a-553e-49a1-bde4-d3b1ff0d83e0 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:48.753399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0368a-553e-49a1-bde4-d3b1ff0d83e0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:48.753399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0368a-553e-49a1-bde4-d3b1ff0d83e0 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:48.757536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 704/1404] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:48.760045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e5331-b8ea-48f9-8abf-bd128631059e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:48.760540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e5331-b8ea-48f9-8abf-bd128631059e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:48.761107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e5331-b8ea-48f9-8abf-bd128631059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:48.832998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f06e5331-b8ea-48f9-8abf-bd128631059e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:48.834498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f06e5331-b8ea-48f9-8abf-bd128631059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:48.949278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 701/1405] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:48.996576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0368a-553e-49a1-bde4-d3b1ff0d83e0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:48.998342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0df0368a-553e-49a1-bde4-d3b1ff0d83e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:49.151251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:49.162334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0368a-553e-49a1-bde4-d3b1ff0d83e0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:49.294479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16215f-b7f9-439e-bed2-1828d772d091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:49.295245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16215f-b7f9-439e-bed2-1828d772d091 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:49.295531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16215f-b7f9-439e-bed2-1828d772d091 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:49.295799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16215f-b7f9-439e-bed2-1828d772d091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:49.297445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7f16215f-b7f9-439e-bed2-1828d772d091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:49.399269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16215f-b7f9-439e-bed2-1828d772d091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:49.401219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16215f-b7f9-439e-bed2-1828d772d091 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:49.412985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:49.422571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 705/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:33:51.505105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f645e-6bb5-4e86-a45d-bcf286baa8d5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:51.505650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f645e-6bb5-4e86-a45d-bcf286baa8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:51.505650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f645e-6bb5-4e86-a45d-bcf286baa8d5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:51.507013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 702/1407] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:33:51.512171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776b53d-4b66-444d-9d2d-92ec2455c1f8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:51.512580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776b53d-4b66-444d-9d2d-92ec2455c1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:51.512747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776b53d-4b66-444d-9d2d-92ec2455c1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:51.589699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4776b53d-4b66-444d-9d2d-92ec2455c1f8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:33:51.591261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4776b53d-4b66-444d-9d2d-92ec2455c1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:51.700911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 706/1408] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:33:51.756228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f645e-6bb5-4e86-a45d-bcf286baa8d5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:33:51.756228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6d3f645e-6bb5-4e86-a45d-bcf286baa8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:51.823549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:51.923743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f645e-6bb5-4e86-a45d-bcf286baa8d5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:33:52.047506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4adcd-3141-45dc-b332-d81a75130e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:33:52.048143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4adcd-3141-45dc-b332-d81a75130e79 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:33:52.048636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4adcd-3141-45dc-b332-d81a75130e79 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:33:52.048917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4adcd-3141-45dc-b332-d81a75130e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:33:52.051698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-90f4adcd-3141-45dc-b332-d81a75130e79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:33:52.065923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:33:52.158237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4adcd-3141-45dc-b332-d81a75130e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:33:52.160070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4adcd-3141-45dc-b332-d81a75130e79 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:33:52.183149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 703/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:01.698818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=67 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:02.177330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=39 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:08.824631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e95d-eae1-4a66-9789-63d95334aac7 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:08.825230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e95d-eae1-4a66-9789-63d95334aac7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:08.825230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e95d-eae1-4a66-9789-63d95334aac7 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:08.826576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 707/1410] 10.222.0.57 () {54 vars in 918 bytes} [Thu Aug 4 04:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:08.831703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216fd08-79fb-4d81-bc94-a4855d978a59 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:08.832145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216fd08-79fb-4d81-bc94-a4855d978a59 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:08.832247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216fd08-79fb-4d81-bc94-a4855d978a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:08.908589 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6216fd08-79fb-4d81-bc94-a4855d978a59 None None] MFA Rules not processed for user `a5c20a5a655b43d1899bf2319647a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:08.909803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6216fd08-79fb-4d81-bc94-a4855d978a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:09.039892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 704/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Aug 4 04:34:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:09.055400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25513490-7656-4be4-bb7e-8a6da3a8220d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:09.055686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25513490-7656-4be4-bb7e-8a6da3a8220d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:09.055978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25513490-7656-4be4-bb7e-8a6da3a8220d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:09.057315 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 708/1412] 10.222.0.57 () {54 vars in 918 bytes} [Thu Aug 4 04:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:34:09.061905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3bc30-3b4a-49d2-b990-0c0a274c0bb8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:09.062194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3bc30-3b4a-49d2-b990-0c0a274c0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:09.062463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3bc30-3b4a-49d2-b990-0c0a274c0bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:09.133681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:09.137051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e3e3bc30-3b4a-49d2-b990-0c0a274c0bb8 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:09.138818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e3e3bc30-3b4a-49d2-b990-0c0a274c0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:09.254530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 705/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Aug 4 04:34:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:11.777976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d70fd-79fc-4efd-9451-b6158d3f5c90 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:11.778433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d70fd-79fc-4efd-9451-b6158d3f5c90 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:11.778585 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d70fd-79fc-4efd-9451-b6158d3f5c90 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:11.780706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:11.785892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d6fda-1908-4230-9858-19c68fc083a3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:11.786294 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d6fda-1908-4230-9858-19c68fc083a3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:11.786445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d6fda-1908-4230-9858-19c68fc083a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:11.852106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d05d6fda-1908-4230-9858-19c68fc083a3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:11.853296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d05d6fda-1908-4230-9858-19c68fc083a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:11.908536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:11.952735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:11.994838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d70fd-79fc-4efd-9451-b6158d3f5c90 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:11.996354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5f2d70fd-79fc-4efd-9451-b6158d3f5c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:12.144628 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d70fd-79fc-4efd-9451-b6158d3f5c90 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:12.216577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:12.258827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3e47-7d21-49cb-9b4f-0e94582e88c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:12.259399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3e47-7d21-49cb-9b4f-0e94582e88c2 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:12.259675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3e47-7d21-49cb-9b4f-0e94582e88c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:12.259942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3e47-7d21-49cb-9b4f-0e94582e88c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:12.261554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6e0d3e47-7d21-49cb-9b4f-0e94582e88c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:12.348739 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d3e47-7d21-49cb-9b4f-0e94582e88c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:12.350332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d3e47-7d21-49cb-9b4f-0e94582e88c2 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:12.368316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 710/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:13.285742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2af96-e05c-4b6c-8f32-1f63e0aef9f5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:13.286284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2af96-e05c-4b6c-8f32-1f63e0aef9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:13.286284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2af96-e05c-4b6c-8f32-1f63e0aef9f5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:13.287705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:13.292645 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf054b3-5f13-4471-a8fa-2beb5fe80cb2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:13.293323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf054b3-5f13-4471-a8fa-2beb5fe80cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:13.293455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf054b3-5f13-4471-a8fa-2beb5fe80cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:13.367611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1cf054b3-5f13-4471-a8fa-2beb5fe80cb2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:13.368805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1cf054b3-5f13-4471-a8fa-2beb5fe80cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:13.394388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:13.463599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:13.620072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2af96-e05c-4b6c-8f32-1f63e0aef9f5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:13.621534 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-22e2af96-e05c-4b6c-8f32-1f63e0aef9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:13.773352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2af96-e05c-4b6c-8f32-1f63e0aef9f5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:13.813661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:13.887334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d632857-a57a-4ffe-bf23-2c0cad0910fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:13.887891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d632857-a57a-4ffe-bf23-2c0cad0910fa service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:13.888167 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d632857-a57a-4ffe-bf23-2c0cad0910fa service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:13.888433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d632857-a57a-4ffe-bf23-2c0cad0910fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:13.890560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d632857-a57a-4ffe-bf23-2c0cad0910fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:13.978685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d632857-a57a-4ffe-bf23-2c0cad0910fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:13.980311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d632857-a57a-4ffe-bf23-2c0cad0910fa service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:13.997829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 708/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:14.879988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecffe91-0b2d-4c42-b53a-8d81711f3698 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:14.880558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecffe91-0b2d-4c42-b53a-8d81711f3698 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:14.880558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecffe91-0b2d-4c42-b53a-8d81711f3698 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:14.881890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:14.886713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d486562-dac9-4432-8f03-e8770d60bbc7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:14.887160 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d486562-dac9-4432-8f03-e8770d60bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:14.887277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d486562-dac9-4432-8f03-e8770d60bbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:14.941247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:14.962648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9d486562-dac9-4432-8f03-e8770d60bbc7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:14.963896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9d486562-dac9-4432-8f03-e8770d60bbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:15.060865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:15.212945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecffe91-0b2d-4c42-b53a-8d81711f3698 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:15.214463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fecffe91-0b2d-4c42-b53a-8d81711f3698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:15.356650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecffe91-0b2d-4c42-b53a-8d81711f3698 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:15.368874 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:15.470324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f85d58-c547-418f-b0b4-25e08ef40806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:15.471058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f85d58-c547-418f-b0b4-25e08ef40806 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:15.471525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f85d58-c547-418f-b0b4-25e08ef40806 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:15.471931 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f85d58-c547-418f-b0b4-25e08ef40806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:15.473735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e1f85d58-c547-418f-b0b4-25e08ef40806 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:15.562281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f85d58-c547-418f-b0b4-25e08ef40806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:15.563887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f85d58-c547-418f-b0b4-25e08ef40806 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:15.583955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 713/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:16.454133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd138b-6d34-44ae-91f6-56d7a509d57c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:16.454728 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd138b-6d34-44ae-91f6-56d7a509d57c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:16.454728 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd138b-6d34-44ae-91f6-56d7a509d57c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:16.456082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:16.461359 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2377fc7-7777-479e-b008-b85479d41759 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:16.461737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2377fc7-7777-479e-b008-b85479d41759 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:16.461947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2377fc7-7777-479e-b008-b85479d41759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:16.482109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:16.538226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a2377fc7-7777-479e-b008-b85479d41759 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:16.539443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a2377fc7-7777-479e-b008-b85479d41759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:16.635144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:16.786488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd138b-6d34-44ae-91f6-56d7a509d57c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:16.788050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c2fd138b-6d34-44ae-91f6-56d7a509d57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:16.898723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:16.934692 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd138b-6d34-44ae-91f6-56d7a509d57c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:17.045422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b40a6-6a72-465b-8b94-1ecac841bfeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:17.045954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b40a6-6a72-465b-8b94-1ecac841bfeb service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:17.046232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b40a6-6a72-465b-8b94-1ecac841bfeb service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:17.046501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b40a6-6a72-465b-8b94-1ecac841bfeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:17.048163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ce2b40a6-6a72-465b-8b94-1ecac841bfeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:17.123711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:17.137630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b40a6-6a72-465b-8b94-1ecac841bfeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:17.139816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b40a6-6a72-465b-8b94-1ecac841bfeb service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:17.157404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 711/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:18.025829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed436d-000b-42d5-a513-06c640a6dff8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:18.026346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed436d-000b-42d5-a513-06c640a6dff8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:18.026346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed436d-000b-42d5-a513-06c640a6dff8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:18.027788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:18.033216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f5b36-c9f1-44ed-9b05-e93f0547bf91 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:18.033643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f5b36-c9f1-44ed-9b05-e93f0547bf91 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:18.033739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f5b36-c9f1-44ed-9b05-e93f0547bf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:18.109680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-523f5b36-c9f1-44ed-9b05-e93f0547bf91 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:18.110877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-523f5b36-c9f1-44ed-9b05-e93f0547bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:18.204762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:18.356088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed436d-000b-42d5-a513-06c640a6dff8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:18.357537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d7ed436d-000b-42d5-a513-06c640a6dff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:18.440933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:18.502002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed436d-000b-42d5-a513-06c640a6dff8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:18.615638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cf68b-e1bc-48a5-bca4-b38faf364cbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:18.616172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cf68b-e1bc-48a5-bca4-b38faf364cbe service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:18.616450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cf68b-e1bc-48a5-bca4-b38faf364cbe service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:18.616720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cf68b-e1bc-48a5-bca4-b38faf364cbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:18.618342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-309cf68b-e1bc-48a5-bca4-b38faf364cbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:18.672247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:18.713612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cf68b-e1bc-48a5-bca4-b38faf364cbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:18.715236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cf68b-e1bc-48a5-bca4-b38faf364cbe service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:18.734189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 716/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:19.555463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361b580-37d9-48a3-9868-d06bfdc5fca6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:19.556027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361b580-37d9-48a3-9868-d06bfdc5fca6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:19.556027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361b580-37d9-48a3-9868-d06bfdc5fca6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:19.557378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:19.562362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1a90-1e02-4857-ae3b-549dfd3894e5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:19.562838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1a90-1e02-4857-ae3b-549dfd3894e5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:19.562953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1a90-1e02-4857-ae3b-549dfd3894e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:19.639268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4a9c1a90-1e02-4857-ae3b-549dfd3894e5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:19.640557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4a9c1a90-1e02-4857-ae3b-549dfd3894e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:19.736478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:34:19.885159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361b580-37d9-48a3-9868-d06bfdc5fca6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:19.886697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3361b580-37d9-48a3-9868-d06bfdc5fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:19.936813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:20.033608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361b580-37d9-48a3-9868-d06bfdc5fca6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:20.144894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bcdd4-7fbb-49bb-8239-d704c932be6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:20.145505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bcdd4-7fbb-49bb-8239-d704c932be6b service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:20.145782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bcdd4-7fbb-49bb-8239-d704c932be6b service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:20.146051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bcdd4-7fbb-49bb-8239-d704c932be6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:20.147770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e33bcdd4-7fbb-49bb-8239-d704c932be6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:20.154523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:20.236625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bcdd4-7fbb-49bb-8239-d704c932be6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:20.238242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bcdd4-7fbb-49bb-8239-d704c932be6b service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:20.256447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 714/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:21.094599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72870eac-99d9-49c3-92d3-7a451c43c5b3 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:21.095334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72870eac-99d9-49c3-92d3-7a451c43c5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:21.095334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72870eac-99d9-49c3-92d3-7a451c43c5b3 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:21.096717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:21.101779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc95a8-ee29-4d8f-8651-573f363c29a4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:21.102231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc95a8-ee29-4d8f-8651-573f363c29a4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:21.102339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc95a8-ee29-4d8f-8651-573f363c29a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:21.177559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-72bc95a8-ee29-4d8f-8651-573f363c29a4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:21.178761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-72bc95a8-ee29-4d8f-8651-573f363c29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:21.245391 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:21.276891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:21.447273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72870eac-99d9-49c3-92d3-7a451c43c5b3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:21.448797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-72870eac-99d9-49c3-92d3-7a451c43c5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:21.467636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:21.601564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72870eac-99d9-49c3-92d3-7a451c43c5b3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:21.689549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:21.716734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e69da0-c1d5-4b17-b4bf-47526ef82067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:21.717353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e69da0-c1d5-4b17-b4bf-47526ef82067 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:21.717633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e69da0-c1d5-4b17-b4bf-47526ef82067 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:21.717959 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e69da0-c1d5-4b17-b4bf-47526ef82067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:21.719642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-56e69da0-c1d5-4b17-b4bf-47526ef82067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:21.815550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e69da0-c1d5-4b17-b4bf-47526ef82067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:21.817167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e69da0-c1d5-4b17-b4bf-47526ef82067 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:21.836132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 719/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:22.644582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774bba-0588-4382-95c3-567b92937eb6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:22.645126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774bba-0588-4382-95c3-567b92937eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:22.645126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774bba-0588-4382-95c3-567b92937eb6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:22.646414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:22.651267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c6d93-9936-441a-9acd-7dc888596f1b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:22.651713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c6d93-9936-441a-9acd-7dc888596f1b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:22.651851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c6d93-9936-441a-9acd-7dc888596f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:22.729255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3d5c6d93-9936-441a-9acd-7dc888596f1b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:22.730467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3d5c6d93-9936-441a-9acd-7dc888596f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:22.775549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:22.831078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:22.980932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774bba-0588-4382-95c3-567b92937eb6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:22.983306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e9774bba-0588-4382-95c3-567b92937eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:23.133516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774bba-0588-4382-95c3-567b92937eb6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:23.187325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:23.245613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86af31-5582-4eae-925b-d6c5ac95338d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:23.246067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86af31-5582-4eae-925b-d6c5ac95338d service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:23.246349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86af31-5582-4eae-925b-d6c5ac95338d service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:23.246620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86af31-5582-4eae-925b-d6c5ac95338d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:23.248283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fe86af31-5582-4eae-925b-d6c5ac95338d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:23.334803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86af31-5582-4eae-925b-d6c5ac95338d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:23.336448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86af31-5582-4eae-925b-d6c5ac95338d service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:23.354770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 717/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:24.158861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085d489-deea-466d-8de7-53b121a87e96 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:24.159381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085d489-deea-466d-8de7-53b121a87e96 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:24.159489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085d489-deea-466d-8de7-53b121a87e96 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:24.160875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:24.165670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0d99e-4cbd-4900-9ea2-88bbfc232023 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:24.166100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0d99e-4cbd-4900-9ea2-88bbfc232023 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:24.166207 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0d99e-4cbd-4900-9ea2-88bbfc232023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:24.241695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-eae0d99e-4cbd-4900-9ea2-88bbfc232023 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:24.242914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eae0d99e-4cbd-4900-9ea2-88bbfc232023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:24.244958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:24.339814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:24.497074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085d489-deea-466d-8de7-53b121a87e96 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:24.498657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9085d489-deea-466d-8de7-53b121a87e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:24.643367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085d489-deea-466d-8de7-53b121a87e96 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:24.670701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:24.771903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316b2c-8ab1-4afc-b8a8-8eb0898e4b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:24.772519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316b2c-8ab1-4afc-b8a8-8eb0898e4b5e service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:24.772990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316b2c-8ab1-4afc-b8a8-8eb0898e4b5e service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:24.773253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316b2c-8ab1-4afc-b8a8-8eb0898e4b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:24.778132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-26316b2c-8ab1-4afc-b8a8-8eb0898e4b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:24.871665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316b2c-8ab1-4afc-b8a8-8eb0898e4b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:24.873298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316b2c-8ab1-4afc-b8a8-8eb0898e4b5e service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:24.890971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 722/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:26.848563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb5769-d969-4bb1-974e-aa9a9fe5dc2f None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:26.849184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb5769-d969-4bb1-974e-aa9a9fe5dc2f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:26.849184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb5769-d969-4bb1-974e-aa9a9fe5dc2f None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:26.850471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:26.855808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0fcc2-0b3e-43dc-855c-6d6a868c71b7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:26.856239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0fcc2-0b3e-43dc-855c-6d6a868c71b7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:26.856337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0fcc2-0b3e-43dc-855c-6d6a868c71b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:26.897957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:26.924929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-08d0fcc2-0b3e-43dc-855c-6d6a868c71b7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:26.926136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-08d0fcc2-0b3e-43dc-855c-6d6a868c71b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:27.021443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:27.060536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb5769-d969-4bb1-974e-aa9a9fe5dc2f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:27.062117 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f6eb5769-d969-4bb1-974e-aa9a9fe5dc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:27.164685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb5769-d969-4bb1-974e-aa9a9fe5dc2f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:27.196568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:27.238475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94878cfe-cd4d-4679-8d93-a7827e4f5ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:27.239115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94878cfe-cd4d-4679-8d93-a7827e4f5ace service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:27.239402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94878cfe-cd4d-4679-8d93-a7827e4f5ace service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:27.239672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94878cfe-cd4d-4679-8d93-a7827e4f5ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:27.241266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-94878cfe-cd4d-4679-8d93-a7827e4f5ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:27.348599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94878cfe-cd4d-4679-8d93-a7827e4f5ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:27.349957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94878cfe-cd4d-4679-8d93-a7827e4f5ace service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:27.367761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 720/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:29.546750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872e6dc-ae3f-46dd-83b7-b5701763c3a9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:29.547257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872e6dc-ae3f-46dd-83b7-b5701763c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:29.547350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872e6dc-ae3f-46dd-83b7-b5701763c3a9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:29.548713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:29.554193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d8b6a-a23f-4d34-ac9c-5c22490ddd59 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:29.554618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d8b6a-a23f-4d34-ac9c-5c22490ddd59 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:29.554747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d8b6a-a23f-4d34-ac9c-5c22490ddd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:29.620259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-686d8b6a-a23f-4d34-ac9c-5c22490ddd59 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:29.621464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-686d8b6a-a23f-4d34-ac9c-5c22490ddd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:29.633966 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:29.718842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:34:29.760808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872e6dc-ae3f-46dd-83b7-b5701763c3a9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:29.762341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7872e6dc-ae3f-46dd-83b7-b5701763c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:29.865820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872e6dc-ae3f-46dd-83b7-b5701763c3a9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:29.878418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:29.943526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399bf6d-67bd-4fc3-ac2a-897694a61efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:29.944137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399bf6d-67bd-4fc3-ac2a-897694a61efd service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:29.944412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399bf6d-67bd-4fc3-ac2a-897694a61efd service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:29.944708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399bf6d-67bd-4fc3-ac2a-897694a61efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:29.946343 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4399bf6d-67bd-4fc3-ac2a-897694a61efd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:30.056497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399bf6d-67bd-4fc3-ac2a-897694a61efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:30.057931 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399bf6d-67bd-4fc3-ac2a-897694a61efd service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:30.075902 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 725/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:32.836531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3446667-021b-4b85-b99e-a814b660cc41 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:32.837083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3446667-021b-4b85-b99e-a814b660cc41 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:32.837083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3446667-021b-4b85-b99e-a814b660cc41 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:32.838414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:32.844835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df5b51-67b5-4973-a963-e89fa84ab2f9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:32.845352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df5b51-67b5-4973-a963-e89fa84ab2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:32.845787 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df5b51-67b5-4973-a963-e89fa84ab2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:32.901822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:32.919503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c4df5b51-67b5-4973-a963-e89fa84ab2f9 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:32.921707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c4df5b51-67b5-4973-a963-e89fa84ab2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:33.018207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:33.060353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3446667-021b-4b85-b99e-a814b660cc41 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:33.061963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d3446667-021b-4b85-b99e-a814b660cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:33.167335 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3446667-021b-4b85-b99e-a814b660cc41 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:33.210793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:33.250971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18ddea-59ef-4009-8c97-f700a6fb10fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:33.251617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18ddea-59ef-4009-8c97-f700a6fb10fe service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:33.251894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18ddea-59ef-4009-8c97-f700a6fb10fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:33.252162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18ddea-59ef-4009-8c97-f700a6fb10fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:33.253767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-de18ddea-59ef-4009-8c97-f700a6fb10fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:33.361191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18ddea-59ef-4009-8c97-f700a6fb10fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:33.362528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18ddea-59ef-4009-8c97-f700a6fb10fe service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:33.380493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 723/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:35.605372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092bff-7e75-43e2-9abd-686cb22b6a0f None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:35.605924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092bff-7e75-43e2-9abd-686cb22b6a0f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:35.605924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092bff-7e75-43e2-9abd-686cb22b6a0f None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:35.607947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:35.613542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891eea5-4596-4862-8ac2-2cf4934782f8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:35.613970 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891eea5-4596-4862-8ac2-2cf4934782f8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:35.614099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891eea5-4596-4862-8ac2-2cf4934782f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:35.679968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c891eea5-4596-4862-8ac2-2cf4934782f8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:35.681182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c891eea5-4596-4862-8ac2-2cf4934782f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:35.701634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:35.779079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:35.818770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f092bff-7e75-43e2-9abd-686cb22b6a0f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:35.820431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9f092bff-7e75-43e2-9abd-686cb22b6a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:35.934919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f092bff-7e75-43e2-9abd-686cb22b6a0f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:35.958522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:36.012580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42e681-9cc8-4ff0-8a8b-cfac5182c73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:36.013112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42e681-9cc8-4ff0-8a8b-cfac5182c73c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:36.013416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42e681-9cc8-4ff0-8a8b-cfac5182c73c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:36.013689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42e681-9cc8-4ff0-8a8b-cfac5182c73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:36.015360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9b42e681-9cc8-4ff0-8a8b-cfac5182c73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:36.125761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42e681-9cc8-4ff0-8a8b-cfac5182c73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:36.128169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42e681-9cc8-4ff0-8a8b-cfac5182c73c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:36.148051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 728/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:38.238366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6928c-7334-4850-b9a9-7aed16287617 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:38.238954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6928c-7334-4850-b9a9-7aed16287617 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:38.238954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6928c-7334-4850-b9a9-7aed16287617 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:38.240316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:38.245646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70fcb5-847b-4409-ab2c-c37b32ed2ef4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:38.246048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70fcb5-847b-4409-ab2c-c37b32ed2ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:38.246201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70fcb5-847b-4409-ab2c-c37b32ed2ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:38.311015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:38.313975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0c70fcb5-847b-4409-ab2c-c37b32ed2ef4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:38.315830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0c70fcb5-847b-4409-ab2c-c37b32ed2ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:38.412522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:34:38.450548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6928c-7334-4850-b9a9-7aed16287617 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:38.452758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a0c6928c-7334-4850-b9a9-7aed16287617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:38.557281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6928c-7334-4850-b9a9-7aed16287617 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:38.605545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:38.631090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b56b7-6714-4705-ac95-02372c706e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:38.631695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b56b7-6714-4705-ac95-02372c706e28 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:38.631970 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b56b7-6714-4705-ac95-02372c706e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:38.632238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b56b7-6714-4705-ac95-02372c706e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:38.633838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7d1b56b7-6714-4705-ac95-02372c706e28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:38.745714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b56b7-6714-4705-ac95-02372c706e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:38.747218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b56b7-6714-4705-ac95-02372c706e28 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:38.765757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 726/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:40.824103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faaefc-228f-429d-9fe5-78a59df14f0a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:40.824637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faaefc-228f-429d-9fe5-78a59df14f0a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:40.824637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18faaefc-228f-429d-9fe5-78a59df14f0a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:40.826521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:40.831752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318869b-93bd-4b82-b67f-1647ec2b22d4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:40.832155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318869b-93bd-4b82-b67f-1647ec2b22d4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:40.832326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318869b-93bd-4b82-b67f-1647ec2b22d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:40.897702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a318869b-93bd-4b82-b67f-1647ec2b22d4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:40.898921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a318869b-93bd-4b82-b67f-1647ec2b22d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:40.928601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:40.995499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:41.034740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faaefc-228f-429d-9fe5-78a59df14f0a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:41.036501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-18faaefc-228f-429d-9fe5-78a59df14f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:41.140032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18faaefc-228f-429d-9fe5-78a59df14f0a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:41.167619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:41.212987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aa514-9829-4509-8327-b7ed7cb1c657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:41.213601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa514-9829-4509-8327-b7ed7cb1c657 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:41.213883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa514-9829-4509-8327-b7ed7cb1c657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:41.214152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa514-9829-4509-8327-b7ed7cb1c657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:41.215799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b61aa514-9829-4509-8327-b7ed7cb1c657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:41.327875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aa514-9829-4509-8327-b7ed7cb1c657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:41.329215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aa514-9829-4509-8327-b7ed7cb1c657 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:41.346920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 731/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:43.374157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d89959-6002-4d68-a421-b2e1777c602e None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:43.374757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d89959-6002-4d68-a421-b2e1777c602e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:43.374757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d89959-6002-4d68-a421-b2e1777c602e None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:43.376079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:34:43.381226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53f24d-0d9b-48a0-ad4b-434761d4c0d7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:43.381646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53f24d-0d9b-48a0-ad4b-434761d4c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:43.381761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53f24d-0d9b-48a0-ad4b-434761d4c0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:43.455440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7e53f24d-0d9b-48a0-ad4b-434761d4c0d7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:43.456656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7e53f24d-0d9b-48a0-ad4b-434761d4c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:43.464879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:43.554740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:43.592708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d89959-6002-4d68-a421-b2e1777c602e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:43.594226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b5d89959-6002-4d68-a421-b2e1777c602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:43.695512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d89959-6002-4d68-a421-b2e1777c602e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:43.750106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:43.769854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b5e80-a054-4afa-b676-d0bf81fdb9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:43.770465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5e80-a054-4afa-b676-d0bf81fdb9dd service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:43.770747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5e80-a054-4afa-b676-d0bf81fdb9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:43.771045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b5e80-a054-4afa-b676-d0bf81fdb9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:43.772661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a99b5e80-a054-4afa-b676-d0bf81fdb9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:43.881575 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b5e80-a054-4afa-b676-d0bf81fdb9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:43.883009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b5e80-a054-4afa-b676-d0bf81fdb9dd service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:43.901137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 729/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:45.927835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b714-af1d-49ca-a3b2-e2c9589eb7e9 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:45.928403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b714-af1d-49ca-a3b2-e2c9589eb7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:45.928403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b714-af1d-49ca-a3b2-e2c9589eb7e9 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:45.929710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:45.935058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3783580-6977-4e16-ae83-26fb9e0d7049 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:45.935510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3783580-6977-4e16-ae83-26fb9e0d7049 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:45.935623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3783580-6977-4e16-ae83-26fb9e0d7049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:46.000892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b3783580-6977-4e16-ae83-26fb9e0d7049 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:46.002093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b3783580-6977-4e16-ae83-26fb9e0d7049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:46.040543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:46.098826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:46.135815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6b714-af1d-49ca-a3b2-e2c9589eb7e9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:46.137453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aae6b714-af1d-49ca-a3b2-e2c9589eb7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:46.242097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6b714-af1d-49ca-a3b2-e2c9589eb7e9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:46.279487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:46.316809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bba83-7064-4954-a3cb-d0bfb7349a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:46.317350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bba83-7064-4954-a3cb-d0bfb7349a06 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:46.317630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bba83-7064-4954-a3cb-d0bfb7349a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:46.317901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bba83-7064-4954-a3cb-d0bfb7349a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:46.319539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3b2bba83-7064-4954-a3cb-d0bfb7349a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:46.433327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bba83-7064-4954-a3cb-d0bfb7349a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:46.435509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bba83-7064-4954-a3cb-d0bfb7349a06 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:46.454858 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 734/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:48.464022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9d08-96fe-4a2f-a48e-2d211de6be41 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:48.464557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9d08-96fe-4a2f-a48e-2d211de6be41 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:48.464557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9d08-96fe-4a2f-a48e-2d211de6be41 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:48.466029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:48.471651 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03312b44-67fa-43cf-945f-143cde8c8054 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:48.472072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03312b44-67fa-43cf-945f-143cde8c8054 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:48.472203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03312b44-67fa-43cf-945f-143cde8c8054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:48.537331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-03312b44-67fa-43cf-945f-143cde8c8054 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:48.538531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-03312b44-67fa-43cf-945f-143cde8c8054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:48.556330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:48.638728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:48.675264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9d08-96fe-4a2f-a48e-2d211de6be41 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:48.676871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cb5e9d08-96fe-4a2f-a48e-2d211de6be41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:48.781235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9d08-96fe-4a2f-a48e-2d211de6be41 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:48.846657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:48.854173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee62e1-d934-4746-937a-023e0177435c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:48.854784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee62e1-d934-4746-937a-023e0177435c service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:48.855095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee62e1-d934-4746-937a-023e0177435c service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:48.855368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee62e1-d934-4746-937a-023e0177435c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:48.857005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-14ee62e1-d934-4746-937a-023e0177435c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:48.964792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee62e1-d934-4746-937a-023e0177435c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:48.966251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee62e1-d934-4746-937a-023e0177435c service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:48.984375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 732/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:34:51.043446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e255cc9-8129-4af6-905d-698db101c026 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:51.044009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e255cc9-8129-4af6-905d-698db101c026 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:51.044009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e255cc9-8129-4af6-905d-698db101c026 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:51.045372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:34:51.051033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850515-1636-4ce3-bb33-3a3976baf189 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:51.051470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850515-1636-4ce3-bb33-3a3976baf189 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:51.051573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850515-1636-4ce3-bb33-3a3976baf189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:51.117606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-38850515-1636-4ce3-bb33-3a3976baf189 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:34:51.118846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-38850515-1636-4ce3-bb33-3a3976baf189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:51.167344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:51.216378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:34:51.253414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e255cc9-8129-4af6-905d-698db101c026 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:34:51.254941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e255cc9-8129-4af6-905d-698db101c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:51.357994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e255cc9-8129-4af6-905d-698db101c026 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:34:51.404758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:34:51.431361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee84806-ca91-4988-ab57-f0b7d13af088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:34:51.431975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee84806-ca91-4988-ab57-f0b7d13af088 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:34:51.432253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee84806-ca91-4988-ab57-f0b7d13af088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:34:51.432522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee84806-ca91-4988-ab57-f0b7d13af088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:34:51.434474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2ee84806-ca91-4988-ab57-f0b7d13af088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:34:51.548650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee84806-ca91-4988-ab57-f0b7d13af088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:34:51.550084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee84806-ca91-4988-ab57-f0b7d13af088 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:34:51.568383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 737/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:35:01.214588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=22 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:01.566053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=66 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:11.229887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6113-9253-4e33-8e09-3b3b682e3dae None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:11.230457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6113-9253-4e33-8e09-3b3b682e3dae None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:11.230457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6113-9253-4e33-8e09-3b3b682e3dae None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:11.231864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 734/1471] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:35:11.237285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0021d3-21bc-495b-8f0f-e712656b3da1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:11.237729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0021d3-21bc-495b-8f0f-e712656b3da1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:11.237837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0021d3-21bc-495b-8f0f-e712656b3da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:11.302997 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8b0021d3-21bc-495b-8f0f-e712656b3da1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:35:11.304204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8b0021d3-21bc-495b-8f0f-e712656b3da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:11.400012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 738/1472] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:35:11.483849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d2a0a-6686-4f9f-bcaf-8dd2959d287c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:11.484078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d2a0a-6686-4f9f-bcaf-8dd2959d287c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:11.484352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d2a0a-6686-4f9f-bcaf-8dd2959d287c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:11.485688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 735/1473] 10.222.0.57 () {54 vars in 966 bytes} [Thu Aug 4 04:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:35:11.490716 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fc93b-81e1-4fd7-bfa9-ceb6fb1724a0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:11.491026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fc93b-81e1-4fd7-bfa9-ceb6fb1724a0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:11.491307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fc93b-81e1-4fd7-bfa9-ceb6fb1724a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:11.571177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d55fc93b-81e1-4fd7-bfa9-ceb6fb1724a0 None None] MFA Rules not processed for user `955c6cb8893c473fadd028b12bbea69d`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:35:11.572382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d55fc93b-81e1-4fd7-bfa9-ceb6fb1724a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:11.594071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:11.650162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 739/1474] 10.222.0.57 () {58 vars in 1063 bytes} [Thu Aug 4 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:35:11.658439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d2a0a-6686-4f9f-bcaf-8dd2959d287c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:35:11.659975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0e9d2a0a-6686-4f9f-bcaf-8dd2959d287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:11.767189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d2a0a-6686-4f9f-bcaf-8dd2959d287c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:35:11.854967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0069b7c-34c7-4c5d-9946-241f3e94cb0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955c6cb8893c473fadd028b12bbea69d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:35:11.855610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0069b7c-34c7-4c5d-9946-241f3e94cb0c service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:11.856522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0069b7c-34c7-4c5d-9946-241f3e94cb0c service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:11.856797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0069b7c-34c7-4c5d-9946-241f3e94cb0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:11.858454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c0069b7c-34c7-4c5d-9946-241f3e94cb0c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:11.910797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:11.964924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0069b7c-34c7-4c5d-9946-241f3e94cb0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:35:11.966887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0069b7c-34c7-4c5d-9946-241f3e94cb0c service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:35:11.985536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 736/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:35:14.079161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a08df-7a9a-42bc-8afc-7ae0775cf7d2 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:14.079722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a08df-7a9a-42bc-8afc-7ae0775cf7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:14.079722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a08df-7a9a-42bc-8afc-7ae0775cf7d2 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:14.081068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 740/1476] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:35:14.086403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5253-681a-4e85-af61-e2b8dcd9eff1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:14.086816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5253-681a-4e85-af61-e2b8dcd9eff1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:14.087013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b5253-681a-4e85-af61-e2b8dcd9eff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:14.152455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f63b5253-681a-4e85-af61-e2b8dcd9eff1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:35:14.153695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f63b5253-681a-4e85-af61-e2b8dcd9eff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:14.250024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 737/1477] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:35:14.273629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a08df-7a9a-42bc-8afc-7ae0775cf7d2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:35:14.275181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a66a08df-7a9a-42bc-8afc-7ae0775cf7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:14.402159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a08df-7a9a-42bc-8afc-7ae0775cf7d2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:35:14.453065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:14.500174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3780bc3-26d1-448e-96fd-5fa0294a3964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:35:14.500792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3780bc3-26d1-448e-96fd-5fa0294a3964 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:14.501071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3780bc3-26d1-448e-96fd-5fa0294a3964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:14.501347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3780bc3-26d1-448e-96fd-5fa0294a3964 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:14.502034 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3780bc3-26d1-448e-96fd-5fa0294a3964 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:35:14.503878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-c3780bc3-26d1-448e-96fd-5fa0294a3964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:35:14.503878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: warnings.warn(msg) Aug 04 04:35:14.503878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: Aug 04 04:35:14.505030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3780bc3-26d1-448e-96fd-5fa0294a3964 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:35:14.524193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 741/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Aug 4 04:35:14 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:35:16.515578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649800d5-02ab-4de5-9d46-91490305f391 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:16.516152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649800d5-02ab-4de5-9d46-91490305f391 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:16.516152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649800d5-02ab-4de5-9d46-91490305f391 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:16.517637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 738/1479] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:35:16.522909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f0844-7dda-4398-bd25-f0434f11e709 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:16.523376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f0844-7dda-4398-bd25-f0434f11e709 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:16.523513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f0844-7dda-4398-bd25-f0434f11e709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:16.588497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ad8f0844-7dda-4398-bd25-f0434f11e709 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:35:16.589710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad8f0844-7dda-4398-bd25-f0434f11e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:16.686246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 742/1480] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:35:16.729099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649800d5-02ab-4de5-9d46-91490305f391 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:35:16.731169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-649800d5-02ab-4de5-9d46-91490305f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:16.741074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:16.879459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649800d5-02ab-4de5-9d46-91490305f391 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:35:16.956777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:16.989190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baceb84-2a38-4b72-8a92-281f616c1cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:35:16.990085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baceb84-2a38-4b72-8a92-281f616c1cb0 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:16.990367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baceb84-2a38-4b72-8a92-281f616c1cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:16.990639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baceb84-2a38-4b72-8a92-281f616c1cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:16.992255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8baceb84-2a38-4b72-8a92-281f616c1cb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:17.078473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baceb84-2a38-4b72-8a92-281f616c1cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:35:17.080067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baceb84-2a38-4b72-8a92-281f616c1cb0 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:35:17.098231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 739/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:35:19.272370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39b3e5-4e36-4da4-81af-2ac4f88f7ee1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:19.272940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39b3e5-4e36-4da4-81af-2ac4f88f7ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:19.272940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39b3e5-4e36-4da4-81af-2ac4f88f7ee1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:19.274286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 743/1482] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:35:19.280044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529442cf-6bf8-4307-8041-a72b08c87199 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:19.280482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529442cf-6bf8-4307-8041-a72b08c87199 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:19.280597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529442cf-6bf8-4307-8041-a72b08c87199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:19.346563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-529442cf-6bf8-4307-8041-a72b08c87199 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:35:19.347787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-529442cf-6bf8-4307-8041-a72b08c87199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:19.393189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:19.445816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 740/1483] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:35:19.483017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39b3e5-4e36-4da4-81af-2ac4f88f7ee1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:35:19.484595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d39b3e5-4e36-4da4-81af-2ac4f88f7ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:19.507658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:19.589941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39b3e5-4e36-4da4-81af-2ac4f88f7ee1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:35:19.662309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42658d-3606-47d4-bff7-db2931e3a5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:35:19.662957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42658d-3606-47d4-bff7-db2931e3a5ce service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:19.663268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42658d-3606-47d4-bff7-db2931e3a5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:19.663542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42658d-3606-47d4-bff7-db2931e3a5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:19.665172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0f42658d-3606-47d4-bff7-db2931e3a5ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:19.740716 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:19.777229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42658d-3606-47d4-bff7-db2931e3a5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:35:19.778596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42658d-3606-47d4-bff7-db2931e3a5ce service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:35:19.797221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 744/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:35:21.886206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34522c-3de9-46c7-ba30-112fcc0a7907 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:21.886762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34522c-3de9-46c7-ba30-112fcc0a7907 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:21.886762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34522c-3de9-46c7-ba30-112fcc0a7907 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:21.888594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 741/1485] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:35:21.893642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af4ba-650f-4a9f-97a9-f3c66f89222d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:21.894089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af4ba-650f-4a9f-97a9-f3c66f89222d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:21.894190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148af4ba-650f-4a9f-97a9-f3c66f89222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:21.959782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-148af4ba-650f-4a9f-97a9-f3c66f89222d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:35:21.960968 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-148af4ba-650f-4a9f-97a9-f3c66f89222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:22.061243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 745/1486] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:35:22.098256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34522c-3de9-46c7-ba30-112fcc0a7907 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:35:22.099884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0f34522c-3de9-46c7-ba30-112fcc0a7907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:22.202885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34522c-3de9-46c7-ba30-112fcc0a7907 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:35:22.273118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:22.275555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185e848-a25a-4206-bd79-48ece3e73213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:35:22.276245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185e848-a25a-4206-bd79-48ece3e73213 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:22.276768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185e848-a25a-4206-bd79-48ece3e73213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:22.277235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185e848-a25a-4206-bd79-48ece3e73213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:22.279136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c185e848-a25a-4206-bd79-48ece3e73213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:22.396089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185e848-a25a-4206-bd79-48ece3e73213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:35:22.397531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185e848-a25a-4206-bd79-48ece3e73213 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:35:22.416763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 742/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:35:24.625975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa05cff-847d-4537-93ba-2372c7ae4d30 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:24.626542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa05cff-847d-4537-93ba-2372c7ae4d30 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:24.626542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa05cff-847d-4537-93ba-2372c7ae4d30 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:24.627985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 746/1488] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:35:24.633367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb14e-f92c-4090-896b-6b3ccead8f8d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:24.633766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb14e-f92c-4090-896b-6b3ccead8f8d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:24.634041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb14e-f92c-4090-896b-6b3ccead8f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:24.699571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d77bb14e-f92c-4090-896b-6b3ccead8f8d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:35:24.700833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d77bb14e-f92c-4090-896b-6b3ccead8f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:24.755532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:24.800326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 743/1489] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:35:24.841236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa05cff-847d-4537-93ba-2372c7ae4d30 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:35:24.842763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-baa05cff-847d-4537-93ba-2372c7ae4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:24.880178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:24.948361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa05cff-847d-4537-93ba-2372c7ae4d30 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:35:25.021394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337fa3d-2691-4b9a-85b7-4f8f934a1cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:35:25.022000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337fa3d-2691-4b9a-85b7-4f8f934a1cee service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:25.022272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337fa3d-2691-4b9a-85b7-4f8f934a1cee service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:25.022537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337fa3d-2691-4b9a-85b7-4f8f934a1cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:25.024173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c337fa3d-2691-4b9a-85b7-4f8f934a1cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:25.222602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:25.253646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337fa3d-2691-4b9a-85b7-4f8f934a1cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:35:25.255114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337fa3d-2691-4b9a-85b7-4f8f934a1cee service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:35:25.272725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 747/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:35:27.529388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa32b-2674-4359-9ec0-20370854047c None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:27.529813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa32b-2674-4359-9ec0-20370854047c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:27.529930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa32b-2674-4359-9ec0-20370854047c None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:27.531330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 744/1491] 10.222.0.57 () {54 vars in 927 bytes} [Thu Aug 4 04:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:35:27.536499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1992-8447-48c4-8bfe-59d80df7ea79 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:27.536927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1992-8447-48c4-8bfe-59d80df7ea79 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:27.537027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac1992-8447-48c4-8bfe-59d80df7ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:27.611140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-11ac1992-8447-48c4-8bfe-59d80df7ea79 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:35:27.612368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-11ac1992-8447-48c4-8bfe-59d80df7ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:27.710331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 748/1492] 10.222.0.57 () {58 vars in 1024 bytes} [Thu Aug 4 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:35:27.749300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa32b-2674-4359-9ec0-20370854047c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:35:27.750838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-53ffa32b-2674-4359-9ec0-20370854047c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:27.864863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa32b-2674-4359-9ec0-20370854047c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:35:27.938293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc7fc3-228b-43f9-919b-8f8006686c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:35:27.938921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc7fc3-228b-43f9-919b-8f8006686c64 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:35:27.939235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc7fc3-228b-43f9-919b-8f8006686c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:35:27.939512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc7fc3-228b-43f9-919b-8f8006686c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:35:27.941823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9bfc7fc3-228b-43f9-919b-8f8006686c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:35:27.956377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:28.056563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc7fc3-228b-43f9-919b-8f8006686c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:35:28.058002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc7fc3-228b-43f9-919b-8f8006686c64 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:35:28.076379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 745/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:35:37.708457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=82 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:35:38.073542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=50 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:39.067444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af73f-961a-41b7-a7cc-3a8eb053f0c6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:39.067999 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af73f-961a-41b7-a7cc-3a8eb053f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:39.067999 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84af73f-961a-41b7-a7cc-3a8eb053f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:39.140419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a84af73f-961a-41b7-a7cc-3a8eb053f0c6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:36:39.141617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a84af73f-961a-41b7-a7cc-3a8eb053f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:39.239340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 749/1494] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:36:39.247489 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825e67c-b2a8-4dfc-b6c4-6cd4338a679e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:39.247969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825e67c-b2a8-4dfc-b6c4-6cd4338a679e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:39.248079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825e67c-b2a8-4dfc-b6c4-6cd4338a679e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:39.324208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8825e67c-b2a8-4dfc-b6c4-6cd4338a679e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:36:39.325794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8825e67c-b2a8-4dfc-b6c4-6cd4338a679e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:39.422787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 746/1495] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:36:39.427496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af73f-961a-41b7-a7cc-3a8eb053f0c6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:39.428729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a84af73f-961a-41b7-a7cc-3a8eb053f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:39.440323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84af73f-961a-41b7-a7cc-3a8eb053f0c6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:39.502697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:39.538647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:39.539374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:39.539655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:39.539927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:39.540614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:36:39.540914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:39.541922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:39.541922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: warnings.warn(msg) Aug 04 04:36:39.541922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: Aug 04 04:36:39.542794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:39.554498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 750/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:36:39.563411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825e67c-b2a8-4dfc-b6c4-6cd4338a679e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:39.573230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825e67c-b2a8-4dfc-b6c4-6cd4338a679e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:39.633545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:39.667824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:39.668696 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:39.668995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:39.669267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:39.669930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:39.671710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:39.671710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: warnings.warn(msg) Aug 04 04:36:39.671710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: Aug 04 04:36:39.672909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:39.735917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 747/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:36:39 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:36:39.740278 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:39.741832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:39.780037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c45029-887c-4e19-8e7e-e3bccfac5dba admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:39.873679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:39.874209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:39.874488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:39.874753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:39.875438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:39.876436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:39.876436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: warnings.warn(msg) Aug 04 04:36:39.876436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: Aug 04 04:36:39.877642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:39.917504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 751/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:36:39 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:36:39.921923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:39.923467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:39.985459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefe360-0bf3-4a1f-ab53-24447681803a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:40.068508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:40.080014 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:40.080632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:40.080913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:40.081186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:40.081879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:40.082883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:40.082883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: warnings.warn(msg) Aug 04 04:36:40.082883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: Aug 04 04:36:40.083812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:40.096079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 748/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:36:40.100225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:40.101721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:40.113304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c026a92-3cc2-413d-b75e-d3332acf4023 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:40.138363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:40.212515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f2e6-0d00-4c49-8c4b-963d82e4091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:40.213549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f2e6-0d00-4c49-8c4b-963d82e4091c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:40.213993 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f2e6-0d00-4c49-8c4b-963d82e4091c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:40.214456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f2e6-0d00-4c49-8c4b-963d82e4091c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:40.215625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f2e6-0d00-4c49-8c4b-963d82e4091c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:40.216922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-5d99f2e6-0d00-4c49-8c4b-963d82e4091c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:40.216922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: warnings.warn(msg) Aug 04 04:36:40.216922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: Aug 04 04:36:40.217805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f2e6-0d00-4c49-8c4b-963d82e4091c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:40.230607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 752/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:36:40.235241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:40.236769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:40.270163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6639-5ce2-4bd0-bf0a-5710dea0d7bc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:40.364095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fae58-7e66-442e-8b2c-7f8e1181712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:40.364756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fae58-7e66-442e-8b2c-7f8e1181712b admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:40.365042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fae58-7e66-442e-8b2c-7f8e1181712b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:40.365313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fae58-7e66-442e-8b2c-7f8e1181712b admin admin] PATH_INFO: `/v3/projects/a1b29c2597fe4d839bcdc14b1e9f9f8d/users/59765c7274844669a231d2cb60166070/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:40.386830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fae58-7e66-442e-8b2c-7f8e1181712b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b29c2597fe4d839bcdc14b1e9f9f8d, user_id=59765c7274844669a231d2cb60166070, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:40.387873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-a25fae58-7e66-442e-8b2c-7f8e1181712b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:40.387873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: warnings.warn(msg) Aug 04 04:36:40.387873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: Aug 04 04:36:40.389873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fae58-7e66-442e-8b2c-7f8e1181712b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:40.414375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 749/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:36:40 2022] PUT /identity/v3/projects/a1b29c2597fe4d839bcdc14b1e9f9f8d/users/59765c7274844669a231d2cb60166070/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:36:40.427284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378fbe-555a-4561-ad5b-aba66377b17f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:40.427573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378fbe-555a-4561-ad5b-aba66377b17f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:40.427848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378fbe-555a-4561-ad5b-aba66377b17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:40.484093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-15378fbe-555a-4561-ad5b-aba66377b17f None None] MFA Rules not processed for user `59765c7274844669a231d2cb60166070`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:36:40.485292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-15378fbe-555a-4561-ad5b-aba66377b17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:40.576333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 753/1502] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:36:40.588508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b1ac9-5db6-416c-bca5-ae5d5b0d58d6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:40.588794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b1ac9-5db6-416c-bca5-ae5d5b0d58d6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:40.589072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b1ac9-5db6-416c-bca5-ae5d5b0d58d6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:40.590418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 750/1503] 10.222.0.57 () {54 vars in 964 bytes} [Thu Aug 4 04:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:36:40.595555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394df37-0b87-4773-898a-b5c40cabb76d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:40.595844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394df37-0b87-4773-898a-b5c40cabb76d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:40.596115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394df37-0b87-4773-898a-b5c40cabb76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:40.627512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:40.672803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0394df37-0b87-4773-898a-b5c40cabb76d None None] MFA Rules not processed for user `7a7ad7efdc2849ca98386decbfd77879`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:36:40.673951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0394df37-0b87-4773-898a-b5c40cabb76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:40.748688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 754/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Thu Aug 4 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:36:40.756657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b1ac9-5db6-416c-bca5-ae5d5b0d58d6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:40.758158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-226b1ac9-5db6-416c-bca5-ae5d5b0d58d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:40.808381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:40.862596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b1ac9-5db6-416c-bca5-ae5d5b0d58d6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:40.935095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:40.935727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:40.935985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:40.936254 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:40.937862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:41.037691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:41.039142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:41.042758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:41.058467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 751/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:36:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:36:41.104015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8edb60-71db-480a-9fd2-fd634c0341f8 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:41.104455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8edb60-71db-480a-9fd2-fd634c0341f8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:41.104576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8edb60-71db-480a-9fd2-fd634c0341f8 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:41.105849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 755/1506] 10.222.0.57 () {52 vars in 830 bytes} [Thu Aug 4 04:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:36:41.109441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:41.110634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:41.209047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34030446-ca75-47d1-9ece-e5732bda7718 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:41.303701 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:41.304339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:41.304603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:41.304872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] PATH_INFO: `/v3/users/59765c7274844669a231d2cb60166070` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:41.317478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59765c7274844669a231d2cb60166070)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:41.318491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:41.318491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: warnings.warn(msg) Aug 04 04:36:41.318491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: Aug 04 04:36:41.319769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:41.329833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:41.389876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59765c7274844669a231d2cb60166070'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:41.390399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59765c7274844669a231d2cb60166070'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:41.413323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59765c7274844669a231d2cb60166070'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:41.423287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59765c7274844669a231d2cb60166070'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:41.423778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59765c7274844669a231d2cb60166070'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:41.442948 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 752/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:36:41 2022] DELETE /identity/v3/users/59765c7274844669a231d2cb60166070 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:36:41.448300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb876-01bd-474f-ad45-60373b9927da None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:41.448587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb876-01bd-474f-ad45-60373b9927da None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:41.448860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb876-01bd-474f-ad45-60373b9927da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:41.505929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b48fb876-01bd-474f-ad45-60373b9927da None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:36:41.507093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b48fb876-01bd-474f-ad45-60373b9927da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:41.589349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:41.601950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 756/1508] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:36:41.611651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:41.612908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:41.713408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ecc1c-714a-4de0-b987-ff8e306f0a4b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:41.772502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:41.795053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9ddc7-93aa-4350-a320-a575a3c86158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:41.795677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9ddc7-93aa-4350-a320-a575a3c86158 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:41.795962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9ddc7-93aa-4350-a320-a575a3c86158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:41.796236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9ddc7-93aa-4350-a320-a575a3c86158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:41.797848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dbb9ddc7-93aa-4350-a320-a575a3c86158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:41.911380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9ddc7-93aa-4350-a320-a575a3c86158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:41.912831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9ddc7-93aa-4350-a320-a575a3c86158 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:41.931495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 753/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:36:42.271428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb876-01bd-474f-ad45-60373b9927da None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:36:42.272614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b48fb876-01bd-474f-ad45-60373b9927da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:36:42.284263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb876-01bd-474f-ad45-60373b9927da None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:36:42.387508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:36:42.388150 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:36:42.388430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:36:42.388704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] PATH_INFO: `/v3/projects/a1b29c2597fe4d839bcdc14b1e9f9f8d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:36:42.398643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b29c2597fe4d839bcdc14b1e9f9f8d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:36:42.399735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:36:42.399735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: warnings.warn(msg) Aug 04 04:36:42.399735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: Aug 04 04:36:42.400936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:36:42.459777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b29c2597fe4d839bcdc14b1e9f9f8d', 'request_id': 'req-a051ff1e-3fff-4d74-97ab-68ee01e919c6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:42.465791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b29c2597fe4d839bcdc14b1e9f9f8d', 'request_id': 'req-a051ff1e-3fff-4d74-97ab-68ee01e919c6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:42.475177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b29c2597fe4d839bcdc14b1e9f9f8d', 'request_id': 'req-a051ff1e-3fff-4d74-97ab-68ee01e919c6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:42.505530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] The token cache is being invalidate because project a1b29c2597fe4d839bcdc14b1e9f9f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:36:42.505824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:42.506358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a051ff1e-3fff-4d74-97ab-68ee01e919c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:36:42.507769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 757/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:36:42 2022] DELETE /identity/v3/projects/a1b29c2597fe4d839bcdc14b1e9f9f8d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:36:51.928756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=62 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:36:52.503367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:21.404266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a087-3086-4114-adb4-b2f910a14d74 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:21.405502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a087-3086-4114-adb4-b2f910a14d74 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:21.405502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a087-3086-4114-adb4-b2f910a14d74 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:21.406854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:38:21.411720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ad305-995e-453a-8177-c94ad6f996cc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:21.412115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ad305-995e-453a-8177-c94ad6f996cc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:21.412303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ad305-995e-453a-8177-c94ad6f996cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:21.494744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b75ad305-995e-453a-8177-c94ad6f996cc None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:21.496033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b75ad305-995e-453a-8177-c94ad6f996cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:21.598885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:21.751797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a087-3086-4114-adb4-b2f910a14d74 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:38:21.753919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c6d9a087-3086-4114-adb4-b2f910a14d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:21.876928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a087-3086-4114-adb4-b2f910a14d74 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:38:21.882486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc7b1d-b838-4df5-ba67-180b45a2ef9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:38:21.883133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc7b1d-b838-4df5-ba67-180b45a2ef9e service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:21.883415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc7b1d-b838-4df5-ba67-180b45a2ef9e service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:21.883688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc7b1d-b838-4df5-ba67-180b45a2ef9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:21.892416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc7b1d-b838-4df5-ba67-180b45a2ef9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:38:21.893993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc7b1d-b838-4df5-ba67-180b45a2ef9e service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:38:21.903394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 755/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:38:22.740918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96434d-bad0-41d8-9d16-7b5c06fa4d28 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:22.741470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96434d-bad0-41d8-9d16-7b5c06fa4d28 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:22.741470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96434d-bad0-41d8-9d16-7b5c06fa4d28 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:22.742905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:38:22.747804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f5c7-ee0d-40a7-8233-50c922c74bc8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:22.748244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f5c7-ee0d-40a7-8233-50c922c74bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:22.748982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f5c7-ee0d-40a7-8233-50c922c74bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:22.772936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dba5f5c7-ee0d-40a7-8233-50c922c74bc8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:22.774768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dba5f5c7-ee0d-40a7-8233-50c922c74bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:22.782765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:22.934389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96434d-bad0-41d8-9d16-7b5c06fa4d28 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:38:22.949079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96434d-bad0-41d8-9d16-7b5c06fa4d28 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:38:22.955034 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa4d22-c4c0-41e6-88b2-6cb69139b7a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:38:22.955635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa4d22-c4c0-41e6-88b2-6cb69139b7a9 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:22.955914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa4d22-c4c0-41e6-88b2-6cb69139b7a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:22.956183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa4d22-c4c0-41e6-88b2-6cb69139b7a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:22.964341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa4d22-c4c0-41e6-88b2-6cb69139b7a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:38:22.965908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa4d22-c4c0-41e6-88b2-6cb69139b7a9 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:38:22.975246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 760/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:38:23.465983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c728ca-388f-4557-af7d-207bf6d2ffb7 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:23.466270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c728ca-388f-4557-af7d-207bf6d2ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:23.466542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c728ca-388f-4557-af7d-207bf6d2ffb7 None None] PATH_INFO: `/v3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:23.468469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 757/1517] 10.222.0.64 () {54 vars in 925 bytes} [Thu Aug 4 04:38:23 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:38:23.474734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cd0fb-14dc-42b0-b9f3-b0d71821a3aa None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:23.475053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cd0fb-14dc-42b0-b9f3-b0d71821a3aa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:23.475360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cd0fb-14dc-42b0-b9f3-b0d71821a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:23.534274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d60cd0fb-14dc-42b0-b9f3-b0d71821a3aa None None] MFA Rules not processed for user `a5c20a5a655b43d1899bf2319647a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:23.535514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d60cd0fb-14dc-42b0-b9f3-b0d71821a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:23.552052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:23.606424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 761/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Aug 4 04:38:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:27.414650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048ccb-3d5c-4610-945b-32eaa47c5b6d None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:27.415223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048ccb-3d5c-4610-945b-32eaa47c5b6d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:27.415223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048ccb-3d5c-4610-945b-32eaa47c5b6d None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:27.416480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 758/1519] 10.222.0.57 () {54 vars in 961 bytes} [Thu Aug 4 04:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:38:27.422495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71a6a-b8e0-434a-871b-17cdb2c2659f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:27.422920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71a6a-b8e0-434a-871b-17cdb2c2659f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:27.423060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71a6a-b8e0-434a-871b-17cdb2c2659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:27.442141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5df71a6a-b8e0-434a-871b-17cdb2c2659f None None] MFA Rules not processed for user `a5c20a5a655b43d1899bf2319647a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:27.443357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5df71a6a-b8e0-434a-871b-17cdb2c2659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:27.451823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 762/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Thu Aug 4 04:38:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:27.459396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db048ccb-3d5c-4610-945b-32eaa47c5b6d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:38:27.473075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db048ccb-3d5c-4610-945b-32eaa47c5b6d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:38:27.477967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7fad-433f-4e77-afc1-bad6a5b48cde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:38:27.478562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7fad-433f-4e77-afc1-bad6a5b48cde service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:27.478837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7fad-433f-4e77-afc1-bad6a5b48cde service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:27.479143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7fad-433f-4e77-afc1-bad6a5b48cde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:27.487784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f7fad-433f-4e77-afc1-bad6a5b48cde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:38:27.489347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f7fad-433f-4e77-afc1-bad6a5b48cde service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:38:27.498783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 759/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:38:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:38:34.224355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f2d83-cf22-4e89-9c19-201574eded8b None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:34.224895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f2d83-cf22-4e89-9c19-201574eded8b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:34.224895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f2d83-cf22-4e89-9c19-201574eded8b None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:34.226327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:38:34.231392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db88dc-f326-43f5-bbaa-37f7bea28ad7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:34.231807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db88dc-f326-43f5-bbaa-37f7bea28ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:34.231936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db88dc-f326-43f5-bbaa-37f7bea28ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:34.251624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-63db88dc-f326-43f5-bbaa-37f7bea28ad7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:34.252818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-63db88dc-f326-43f5-bbaa-37f7bea28ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:34.260637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:34.414488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f2d83-cf22-4e89-9c19-201574eded8b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:38:34.429595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f2d83-cf22-4e89-9c19-201574eded8b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:38:34.434852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5cea4-23d5-4984-bbcb-c3609045a173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:38:34.435476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5cea4-23d5-4984-bbcb-c3609045a173 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:34.435750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5cea4-23d5-4984-bbcb-c3609045a173 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:34.436020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5cea4-23d5-4984-bbcb-c3609045a173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:34.444317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5cea4-23d5-4984-bbcb-c3609045a173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:38:34.445889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5cea4-23d5-4984-bbcb-c3609045a173 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:38:34.455966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 764/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:38:35.277090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91325d80-df38-4708-b7e2-159039baeccf None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:35.277646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91325d80-df38-4708-b7e2-159039baeccf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:35.277646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91325d80-df38-4708-b7e2-159039baeccf None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:35.279093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 04:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:38:35.283861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a203646-35e2-4560-ba55-a2140387c9f4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:35.284231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a203646-35e2-4560-ba55-a2140387c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:35.284439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a203646-35e2-4560-ba55-a2140387c9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:35.305579 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5a203646-35e2-4560-ba55-a2140387c9f4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:35.306778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5a203646-35e2-4560-ba55-a2140387c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:35.315186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 04:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:35.467030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91325d80-df38-4708-b7e2-159039baeccf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:38:35.481212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91325d80-df38-4708-b7e2-159039baeccf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:38:35.486582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb1f23-6435-41b0-880e-792e61b7cfdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:38:35.487219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb1f23-6435-41b0-880e-792e61b7cfdd service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:35.487499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb1f23-6435-41b0-880e-792e61b7cfdd service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:35.487771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb1f23-6435-41b0-880e-792e61b7cfdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:35.496183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb1f23-6435-41b0-880e-792e61b7cfdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:38:35.497789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb1f23-6435-41b0-880e-792e61b7cfdd service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:38:35.507329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 762/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:38:39.454973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced82e-3d8a-475f-a897-3086a8f0152a None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:39.455550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced82e-3d8a-475f-a897-3086a8f0152a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:39.455660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced82e-3d8a-475f-a897-3086a8f0152a None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:39.457200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:38:39.462483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f4504-1ac0-485c-a3ad-5f29a6e309e9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:39.462903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f4504-1ac0-485c-a3ad-5f29a6e309e9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:39.463086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f4504-1ac0-485c-a3ad-5f29a6e309e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:39.483148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ed4f4504-1ac0-485c-a3ad-5f29a6e309e9 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:39.484345 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ed4f4504-1ac0-485c-a3ad-5f29a6e309e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:39.492080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:39.565820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dced82e-3d8a-475f-a897-3086a8f0152a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:38:39.567546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1dced82e-3d8a-475f-a897-3086a8f0152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:39.643583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dced82e-3d8a-475f-a897-3086a8f0152a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:38:39.647202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d283149-0cab-4538-8f79-f823dc0e1f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:38:39.647814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283149-0cab-4538-8f79-f823dc0e1f61 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:39.648097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283149-0cab-4538-8f79-f823dc0e1f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:39.648365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283149-0cab-4538-8f79-f823dc0e1f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:39.657812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d283149-0cab-4538-8f79-f823dc0e1f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:38:39.659259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d283149-0cab-4538-8f79-f823dc0e1f61 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:38:39.668904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 767/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:38:41.729418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37a5d-be11-4a3f-8605-ca2761595fb4 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:41.729956 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37a5d-be11-4a3f-8605-ca2761595fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:41.729956 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37a5d-be11-4a3f-8605-ca2761595fb4 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:41.731426 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:38:41.737435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9fb28-c0ea-435b-b734-ef4d75f35288 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:41.737866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9fb28-c0ea-435b-b734-ef4d75f35288 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:41.737976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9fb28-c0ea-435b-b734-ef4d75f35288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:41.757965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cfc9fb28-c0ea-435b-b734-ef4d75f35288 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:41.759190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cfc9fb28-c0ea-435b-b734-ef4d75f35288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:41.767382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:41.805198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37a5d-be11-4a3f-8605-ca2761595fb4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:38:41.816005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37a5d-be11-4a3f-8605-ca2761595fb4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:38:41.819487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a8768-4d7a-449c-b2cd-062c284ad781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:38:41.820092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a8768-4d7a-449c-b2cd-062c284ad781 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:41.820374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a8768-4d7a-449c-b2cd-062c284ad781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:41.820649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a8768-4d7a-449c-b2cd-062c284ad781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:41.829838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a8768-4d7a-449c-b2cd-062c284ad781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:38:41.831293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a8768-4d7a-449c-b2cd-062c284ad781 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:38:41.840640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 765/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:38:45.369065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48834522-d018-440f-b7bb-583c4fa3fc30 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:45.369631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48834522-d018-440f-b7bb-583c4fa3fc30 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:45.369631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48834522-d018-440f-b7bb-583c4fa3fc30 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:45.371015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:38:45.376705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2731-35ec-49e4-98ed-44eebc69103b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:45.377136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2731-35ec-49e4-98ed-44eebc69103b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:45.377239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2731-35ec-49e4-98ed-44eebc69103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:45.385065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=81 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:45.398145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9c7e2731-35ec-49e4-98ed-44eebc69103b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:45.399369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9c7e2731-35ec-49e4-98ed-44eebc69103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:45.407202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:45.715649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48834522-d018-440f-b7bb-583c4fa3fc30 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:38:45.717312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-48834522-d018-440f-b7bb-583c4fa3fc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:45.788402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:45.806748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48834522-d018-440f-b7bb-583c4fa3fc30 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:38:45.811095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e154ac-db2b-403d-9443-dbb0626a97c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:38:45.811707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e154ac-db2b-403d-9443-dbb0626a97c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:45.811983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e154ac-db2b-403d-9443-dbb0626a97c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:45.812250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e154ac-db2b-403d-9443-dbb0626a97c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:45.822547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e154ac-db2b-403d-9443-dbb0626a97c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:38:45.823996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e154ac-db2b-403d-9443-dbb0626a97c6 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:38:45.833558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 770/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:38:47.922096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364cdf-fa4a-42c3-be5e-75fd7ec74d79 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:47.922689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364cdf-fa4a-42c3-be5e-75fd7ec74d79 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:47.922689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364cdf-fa4a-42c3-be5e-75fd7ec74d79 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:47.924026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 04:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:38:47.929326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91afb-52e7-4247-81b0-4404501f04ad None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:47.929765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91afb-52e7-4247-81b0-4404501f04ad None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:47.929867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91afb-52e7-4247-81b0-4404501f04ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:47.949355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-92c91afb-52e7-4247-81b0-4404501f04ad None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:38:47.951084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-92c91afb-52e7-4247-81b0-4404501f04ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:47.959341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 04:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:38:48.280259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364cdf-fa4a-42c3-be5e-75fd7ec74d79 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:38:48.281996 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7e364cdf-fa4a-42c3-be5e-75fd7ec74d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:38:48.295871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364cdf-fa4a-42c3-be5e-75fd7ec74d79 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:38:48.299393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e6334-6f71-47b5-a5a3-c96acc13e1ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:38:48.300006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e6334-6f71-47b5-a5a3-c96acc13e1ae service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:38:48.300287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e6334-6f71-47b5-a5a3-c96acc13e1ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:38:48.300556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e6334-6f71-47b5-a5a3-c96acc13e1ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:38:48.310315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e6334-6f71-47b5-a5a3-c96acc13e1ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:38:48.311775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e6334-6f71-47b5-a5a3-c96acc13e1ae service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:38:48.321364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 768/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:38:57.944398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=11 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:38:58.317069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=8 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:18.697499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065579e-44e7-4908-8db4-62a10f75f886 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:18.705125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065579e-44e7-4908-8db4-62a10f75f886 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:18.705125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065579e-44e7-4908-8db4-62a10f75f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:18.723173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9065579e-44e7-4908-8db4-62a10f75f886 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:18.724402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9065579e-44e7-4908-8db4-62a10f75f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:18.746180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 772/1540] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:18.755863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2abb-5bb9-4c29-8f7c-25c5ce8f8b8b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:18.756451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2abb-5bb9-4c29-8f7c-25c5ce8f8b8b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:18.756451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a2abb-5bb9-4c29-8f7c-25c5ce8f8b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:18.799209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e23a2abb-5bb9-4c29-8f7c-25c5ce8f8b8b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:18.800083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e23a2abb-5bb9-4c29-8f7c-25c5ce8f8b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:18.815029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 769/1541] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:18.820441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065579e-44e7-4908-8db4-62a10f75f886 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:18.841509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065579e-44e7-4908-8db4-62a10f75f886 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:18.851517 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14464c-c2f1-4fb2-ab9c-381110fcd4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:18.852718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14464c-c2f1-4fb2-ab9c-381110fcd4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:18.852999 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14464c-c2f1-4fb2-ab9c-381110fcd4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:18.853275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14464c-c2f1-4fb2-ab9c-381110fcd4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:18.854074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14464c-c2f1-4fb2-ab9c-381110fcd4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:18.854383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14464c-c2f1-4fb2-ab9c-381110fcd4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:18.860772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14464c-c2f1-4fb2-ab9c-381110fcd4dd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:18.881897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 773/1542] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:18.892185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a2abb-5bb9-4c29-8f7c-25c5ce8f8b8b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:18.908124 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a2abb-5bb9-4c29-8f7c-25c5ce8f8b8b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:18.911968 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951711-2c80-4d6a-84fd-22ce27b12cbb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:18.912259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951711-2c80-4d6a-84fd-22ce27b12cbb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:18.912539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951711-2c80-4d6a-84fd-22ce27b12cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:18.918078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ddfd0-fffb-42d6-b32e-b509f6d6ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:18.919165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ddfd0-fffb-42d6-b32e-b509f6d6ced9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:18.919681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ddfd0-fffb-42d6-b32e-b509f6d6ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:18.920187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ddfd0-fffb-42d6-b32e-b509f6d6ced9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:18.921087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ddfd0-fffb-42d6-b32e-b509f6d6ced9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:18.923350 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ddfd0-fffb-42d6-b32e-b509f6d6ced9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:18.952167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-97951711-2c80-4d6a-84fd-22ce27b12cbb None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:18.953636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-97951711-2c80-4d6a-84fd-22ce27b12cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:18.969540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 774/1543] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:40:18.988478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5ac59-9e31-4ba3-bc70-7a5ef148d0e3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:18.989194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5ac59-9e31-4ba3-bc70-7a5ef148d0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:18.989675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5ac59-9e31-4ba3-bc70-7a5ef148d0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:18.991518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 770/1544] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:18 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:18.996176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ddfd0-fffb-42d6-b32e-b509f6d6ced9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.028073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-99d5ac59-9e31-4ba3-bc70-7a5ef148d0e3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.029373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-99d5ac59-9e31-4ba3-bc70-7a5ef148d0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.121647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ddfd0-fffb-42d6-b32e-b509f6d6ced9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.136744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935fddb-e1f2-4389-a773-661524c847c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.137412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935fddb-e1f2-4389-a773-661524c847c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.137689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935fddb-e1f2-4389-a773-661524c847c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.137955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935fddb-e1f2-4389-a773-661524c847c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.138647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935fddb-e1f2-4389-a773-661524c847c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.139727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-6935fddb-e1f2-4389-a773-661524c847c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:40:19.139727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: warnings.warn(msg) Aug 04 04:40:19.139727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: Aug 04 04:40:19.140979 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935fddb-e1f2-4389-a773-661524c847c4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.174347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 775/1545] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:40:19.178606 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a78567-3feb-4751-945f-8e3452e12c31 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.181218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a78567-3feb-4751-945f-8e3452e12c31 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.181863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a78567-3feb-4751-945f-8e3452e12c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.186955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 771/1546] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:18 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:19.188952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed164b-a9a5-4102-b532-4f405a7b682a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.189498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed164b-a9a5-4102-b532-4f405a7b682a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.190125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed164b-a9a5-4102-b532-4f405a7b682a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.211997 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e3a78567-3feb-4751-945f-8e3452e12c31 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.213256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e3a78567-3feb-4751-945f-8e3452e12c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.215710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c5ed164b-a9a5-4102-b532-4f405a7b682a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.217032 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c5ed164b-a9a5-4102-b532-4f405a7b682a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.221665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 776/1547] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.222687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b753b-8975-43bd-865b-4803fdc3fcf5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.222976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b753b-8975-43bd-865b-4803fdc3fcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.223280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b753b-8975-43bd-865b-4803fdc3fcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.231825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 772/1548] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.233709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f58293-2f6c-4f25-a91e-52798b43fce2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.234352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f58293-2f6c-4f25-a91e-52798b43fce2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.234835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f58293-2f6c-4f25-a91e-52798b43fce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.248727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3a4b753b-8975-43bd-865b-4803fdc3fcf5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.249951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3a4b753b-8975-43bd-865b-4803fdc3fcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.259010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 777/1549] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.259864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b753b-8975-43bd-865b-4803fdc3fcf5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.261084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b1f58293-2f6c-4f25-a91e-52798b43fce2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.262671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b1f58293-2f6c-4f25-a91e-52798b43fce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.270510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b753b-8975-43bd-865b-4803fdc3fcf5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.272783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 773/1550] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.274322 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f58293-2f6c-4f25-a91e-52798b43fce2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.275991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782238b-84cd-4d44-b154-d313126852a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.276693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782238b-84cd-4d44-b154-d313126852a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.276974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782238b-84cd-4d44-b154-d313126852a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.277249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782238b-84cd-4d44-b154-d313126852a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.277964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782238b-84cd-4d44-b154-d313126852a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:19.278268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782238b-84cd-4d44-b154-d313126852a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.280001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782238b-84cd-4d44-b154-d313126852a3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.287327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f58293-2f6c-4f25-a91e-52798b43fce2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.293748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7399-268b-44f3-9060-fd45319a8e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.294411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7399-268b-44f3-9060-fd45319a8e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.294695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7399-268b-44f3-9060-fd45319a8e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.294967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7399-268b-44f3-9060-fd45319a8e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.295726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7399-268b-44f3-9060-fd45319a8e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.297357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7399-268b-44f3-9060-fd45319a8e1d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.298759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 778/1551] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:19.300512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea525d-b6a4-48af-85ac-0bef212e251e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.301164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea525d-b6a4-48af-85ac-0bef212e251e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.301535 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea525d-b6a4-48af-85ac-0bef212e251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.321653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 774/1552] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:19.323276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3b80f-ec59-452b-939b-42dbc92b7295 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.323740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3b80f-ec59-452b-939b-42dbc92b7295 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.323884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f7ea525d-b6a4-48af-85ac-0bef212e251e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.324302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3b80f-ec59-452b-939b-42dbc92b7295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.325592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f7ea525d-b6a4-48af-85ac-0bef212e251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.334274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 779/1553] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.336461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d7d8b-b81a-42b8-a24a-d17df01a7a54 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.336764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d7d8b-b81a-42b8-a24a-d17df01a7a54 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.337038 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d7d8b-b81a-42b8-a24a-d17df01a7a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.348998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8db3b80f-ec59-452b-939b-42dbc92b7295 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.350298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8db3b80f-ec59-452b-939b-42dbc92b7295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.358143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2c4d7d8b-b81a-42b8-a24a-d17df01a7a54 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.359398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2c4d7d8b-b81a-42b8-a24a-d17df01a7a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.359799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 775/1554] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.364997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284d9d3-6ef7-4e1c-b65b-9e3660b66dd7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.365297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284d9d3-6ef7-4e1c-b65b-9e3660b66dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.365602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284d9d3-6ef7-4e1c-b65b-9e3660b66dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.368135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 780/1555] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.369375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be11ab-ca7c-4967-862e-78cc4c330e7d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.369657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be11ab-ca7c-4967-862e-78cc4c330e7d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.369930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be11ab-ca7c-4967-862e-78cc4c330e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.389752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d0be11ab-ca7c-4967-862e-78cc4c330e7d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.390193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4284d9d3-6ef7-4e1c-b65b-9e3660b66dd7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.391036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0be11ab-ca7c-4967-862e-78cc4c330e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.391499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4284d9d3-6ef7-4e1c-b65b-9e3660b66dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.399952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 781/1556] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.400753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be11ab-ca7c-4967-862e-78cc4c330e7d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.401313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 776/1557] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.403213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2a36e-8da3-4371-aa0c-598e3e963b52 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.403950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2a36e-8da3-4371-aa0c-598e3e963b52 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.404395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2a36e-8da3-4371-aa0c-598e3e963b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.410846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be11ab-ca7c-4967-862e-78cc4c330e7d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.416559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b9966-c3eb-4233-8773-e14ba1606393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.417213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b9966-c3eb-4233-8773-e14ba1606393 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.417492 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b9966-c3eb-4233-8773-e14ba1606393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.417761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b9966-c3eb-4233-8773-e14ba1606393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.418767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b9966-c3eb-4233-8773-e14ba1606393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.419494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-751b9966-c3eb-4233-8773-e14ba1606393 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:40:19.419494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: warnings.warn(msg) Aug 04 04:40:19.419494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: Aug 04 04:40:19.420693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b9966-c3eb-4233-8773-e14ba1606393 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.424311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4bd2a36e-8da3-4371-aa0c-598e3e963b52 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.425517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4bd2a36e-8da3-4371-aa0c-598e3e963b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.433942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 777/1558] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.434780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2a36e-8da3-4371-aa0c-598e3e963b52 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.449761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2a36e-8da3-4371-aa0c-598e3e963b52 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.452506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 782/1559] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:19.453781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062522c-ac91-4078-a0f9-092885982e9b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.454069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062522c-ac91-4078-a0f9-092885982e9b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.454345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062522c-ac91-4078-a0f9-092885982e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.461791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747e80b-0d2a-4cc7-b668-d795d5de5711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.463019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e80b-0d2a-4cc7-b668-d795d5de5711 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.463326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e80b-0d2a-4cc7-b668-d795d5de5711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.463846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e80b-0d2a-4cc7-b668-d795d5de5711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.464801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e80b-0d2a-4cc7-b668-d795d5de5711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.467225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e80b-0d2a-4cc7-b668-d795d5de5711 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.481026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 778/1560] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:19.482180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747e80b-0d2a-4cc7-b668-d795d5de5711 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.484463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0062522c-ac91-4078-a0f9-092885982e9b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.485842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0062522c-ac91-4078-a0f9-092885982e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.495448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747e80b-0d2a-4cc7-b668-d795d5de5711 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.547958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:19.551181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 783/1561] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.552055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062522c-ac91-4078-a0f9-092885982e9b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.560219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.561097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.561571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.561846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.562552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:19.562709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062522c-ac91-4078-a0f9-092885982e9b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.562859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.563907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:40:19.563907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: warnings.warn(msg) Aug 04 04:40:19.563907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: Aug 04 04:40:19.564825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.567424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37160320-c901-4010-88f0-47f1bdfcce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.568037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160320-c901-4010-88f0-47f1bdfcce9e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.568314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160320-c901-4010-88f0-47f1bdfcce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.568581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160320-c901-4010-88f0-47f1bdfcce9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.569269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37160320-c901-4010-88f0-47f1bdfcce9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:19.569567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37160320-c901-4010-88f0-47f1bdfcce9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.571191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37160320-c901-4010-88f0-47f1bdfcce9e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.572853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:19.584073 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 779/1562] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:19.585526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.591213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 784/1563] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:19.592461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37160320-c901-4010-88f0-47f1bdfcce9e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.596699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d024fe-9e0e-45e5-94fa-b743ff2cc2a0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.602435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc815b1-a8ee-4c77-a0dc-9421c3d92435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.603094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc815b1-a8ee-4c77-a0dc-9421c3d92435 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.603272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37160320-c901-4010-88f0-47f1bdfcce9e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.603446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc815b1-a8ee-4c77-a0dc-9421c3d92435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.603640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc815b1-a8ee-4c77-a0dc-9421c3d92435 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.604370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc815b1-a8ee-4c77-a0dc-9421c3d92435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:19.604671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc815b1-a8ee-4c77-a0dc-9421c3d92435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.606289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc815b1-a8ee-4c77-a0dc-9421c3d92435 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.607994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c3403-034a-4399-958e-fa802e34ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.608610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c3403-034a-4399-958e-fa802e34ed23 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.608888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c3403-034a-4399-958e-fa802e34ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.609167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c3403-034a-4399-958e-fa802e34ed23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.609864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c3403-034a-4399-958e-fa802e34ed23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:19.610160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c3403-034a-4399-958e-fa802e34ed23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.611838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c3403-034a-4399-958e-fa802e34ed23 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.622778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 780/1564] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:19.624089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e5438-5740-4cd8-b2fa-9f59119379aa None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.624378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e5438-5740-4cd8-b2fa-9f59119379aa None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.624655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e5438-5740-4cd8-b2fa-9f59119379aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.625464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 785/1565] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:19.626455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c3403-034a-4399-958e-fa802e34ed23 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.639198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c3403-034a-4399-958e-fa802e34ed23 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.643771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71988-e751-4bea-8070-a9349a3b3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.644375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71988-e751-4bea-8070-a9349a3b3659 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.644489 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ed7e5438-5740-4cd8-b2fa-9f59119379aa None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:19.644652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71988-e751-4bea-8070-a9349a3b3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.644923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71988-e751-4bea-8070-a9349a3b3659 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.645578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb71988-e751-4bea-8070-a9349a3b3659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.645681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ed7e5438-5740-4cd8-b2fa-9f59119379aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:19.647508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb71988-e751-4bea-8070-a9349a3b3659 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.653721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 781/1566] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:19.654522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e5438-5740-4cd8-b2fa-9f59119379aa None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.667434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e5438-5740-4cd8-b2fa-9f59119379aa None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.675340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ace8c-5376-4c7b-882b-da7276030e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.675531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 786/1567] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:19.675630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ace8c-5376-4c7b-882b-da7276030e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.675756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71988-e751-4bea-8070-a9349a3b3659 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.675849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ace8c-5376-4c7b-882b-da7276030e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.675849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ace8c-5376-4c7b-882b-da7276030e61 admin admin] PATH_INFO: `/v3/projects/84a9b58a917346379c0d7492c19ba0ac/users/41e527395daf428ab00fd78c2412ed13/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.686351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71988-e751-4bea-8070-a9349a3b3659 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.691887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88af0a9-b8b7-4f88-89d0-def05dfb3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.692604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af0a9-b8b7-4f88-89d0-def05dfb3056 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.692889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af0a9-b8b7-4f88-89d0-def05dfb3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.693191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88af0a9-b8b7-4f88-89d0-def05dfb3056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.693951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88af0a9-b8b7-4f88-89d0-def05dfb3056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:19.694075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ace8c-5376-4c7b-882b-da7276030e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a9b58a917346379c0d7492c19ba0ac, user_id=41e527395daf428ab00fd78c2412ed13, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.694295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88af0a9-b8b7-4f88-89d0-def05dfb3056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.695991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88af0a9-b8b7-4f88-89d0-def05dfb3056 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.696973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ace8c-5376-4c7b-882b-da7276030e61 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.710846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 787/1568] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:19.711830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88af0a9-b8b7-4f88-89d0-def05dfb3056 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.717387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 782/1569] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:19 2022] PUT /identity/v3/projects/84a9b58a917346379c0d7492c19ba0ac/users/41e527395daf428ab00fd78c2412ed13/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:19.717387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ace8c-5376-4c7b-882b-da7276030e61 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.723477 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88af0a9-b8b7-4f88-89d0-def05dfb3056 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.786958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1ef1-4b38-438b-8720-84ca6b8b264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.787612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1ef1-4b38-438b-8720-84ca6b8b264e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.787901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1ef1-4b38-438b-8720-84ca6b8b264e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.788176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1ef1-4b38-438b-8720-84ca6b8b264e admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.788847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1ef1-4b38-438b-8720-84ca6b8b264e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.791587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1ef1-4b38-438b-8720-84ca6b8b264e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.792841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ace8c-5376-4c7b-882b-da7276030e61 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.797464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981775f-8387-4878-b272-d42b0807216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.802123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981775f-8387-4878-b272-d42b0807216e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.802123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981775f-8387-4878-b272-d42b0807216e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.802123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981775f-8387-4878-b272-d42b0807216e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.802123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981775f-8387-4878-b272-d42b0807216e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.802123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981775f-8387-4878-b272-d42b0807216e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.831279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 788/1570] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:19.831279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1ef1-4b38-438b-8720-84ca6b8b264e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.831615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 783/1571] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:19.831615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981775f-8387-4878-b272-d42b0807216e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.901025 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981775f-8387-4878-b272-d42b0807216e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.904803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1ef1-4b38-438b-8720-84ca6b8b264e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:19.905662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333d360-9de8-440f-9c0a-d44dd574aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.906318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d360-9de8-440f-9c0a-d44dd574aeaf admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.906597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d360-9de8-440f-9c0a-d44dd574aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.906866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d360-9de8-440f-9c0a-d44dd574aeaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.907550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333d360-9de8-440f-9c0a-d44dd574aeaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.909457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333d360-9de8-440f-9c0a-d44dd574aeaf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.909895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab698ef7-bdd2-4b21-8532-19cb6ab757e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:19.910543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab698ef7-bdd2-4b21-8532-19cb6ab757e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:19.910824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab698ef7-bdd2-4b21-8532-19cb6ab757e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:19.911133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab698ef7-bdd2-4b21-8532-19cb6ab757e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:19.912255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab698ef7-bdd2-4b21-8532-19cb6ab757e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:19.913991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab698ef7-bdd2-4b21-8532-19cb6ab757e4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:19.941376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 784/1572] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:19.942301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333d360-9de8-440f-9c0a-d44dd574aeaf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.943764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 789/1573] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:19.944662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab698ef7-bdd2-4b21-8532-19cb6ab757e4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:19.966132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:19.966501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:20.011678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab698ef7-bdd2-4b21-8532-19cb6ab757e4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.014422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333d360-9de8-440f-9c0a-d44dd574aeaf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.017817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787f7ff-17fd-4dfb-9ae1-8a5a8411a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.018503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787f7ff-17fd-4dfb-9ae1-8a5a8411a41d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.018780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787f7ff-17fd-4dfb-9ae1-8a5a8411a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.019088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787f7ff-17fd-4dfb-9ae1-8a5a8411a41d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.019801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787f7ff-17fd-4dfb-9ae1-8a5a8411a41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.021417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787f7ff-17fd-4dfb-9ae1-8a5a8411a41d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.021531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6f249-a53f-4471-8349-df01993a5ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.022148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6f249-a53f-4471-8349-df01993a5ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.022425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6f249-a53f-4471-8349-df01993a5ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.022696 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6f249-a53f-4471-8349-df01993a5ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.023424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6f249-a53f-4471-8349-df01993a5ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:20.024374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6f249-a53f-4471-8349-df01993a5ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.026000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6f249-a53f-4471-8349-df01993a5ef1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.032783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 790/1574] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.034251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace76ec-c84f-4694-a6a2-fc26b91c4636 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.034557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace76ec-c84f-4694-a6a2-fc26b91c4636 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.034828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace76ec-c84f-4694-a6a2-fc26b91c4636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.042456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 785/1575] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:20.043709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6f249-a53f-4471-8349-df01993a5ef1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.055928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3ace76ec-c84f-4694-a6a2-fc26b91c4636 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:20.056603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6f249-a53f-4471-8349-df01993a5ef1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.057410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3ace76ec-c84f-4694-a6a2-fc26b91c4636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:20.061728 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3bd5a-e876-4e52-bbe2-f67dd924557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.062465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3bd5a-e876-4e52-bbe2-f67dd924557e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.062841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3bd5a-e876-4e52-bbe2-f67dd924557e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.063151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3bd5a-e876-4e52-bbe2-f67dd924557e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.063812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3bd5a-e876-4e52-bbe2-f67dd924557e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.065795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3bd5a-e876-4e52-bbe2-f67dd924557e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.067292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 791/1576] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:20.068665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace76ec-c84f-4694-a6a2-fc26b91c4636 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.083088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace76ec-c84f-4694-a6a2-fc26b91c4636 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.089598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148a8a-eb44-4029-abb7-41ac8cee58b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.090232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148a8a-eb44-4029-abb7-41ac8cee58b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.090510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148a8a-eb44-4029-abb7-41ac8cee58b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.090942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148a8a-eb44-4029-abb7-41ac8cee58b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.092760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f148a8a-eb44-4029-abb7-41ac8cee58b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.093755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f148a8a-eb44-4029-abb7-41ac8cee58b5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.098418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 786/1577] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:20.099301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3bd5a-e876-4e52-bbe2-f67dd924557e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.118324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 792/1578] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/users => generated 284 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:20.119189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148a8a-eb44-4029-abb7-41ac8cee58b5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.130901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148a8a-eb44-4029-abb7-41ac8cee58b5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.180159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3bd5a-e876-4e52-bbe2-f67dd924557e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.186180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5db86-5078-4af5-9c75-a538b5b5c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.186958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5db86-5078-4af5-9c75-a538b5b5c478 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.187393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5db86-5078-4af5-9c75-a538b5b5c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.187742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5db86-5078-4af5-9c75-a538b5b5c478 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.188569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5db86-5078-4af5-9c75-a538b5b5c478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.190806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5db86-5078-4af5-9c75-a538b5b5c478 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.196400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef93b26-f870-4b5c-81e0-496028ecedaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.197012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93b26-f870-4b5c-81e0-496028ecedaf admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.197292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93b26-f870-4b5c-81e0-496028ecedaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.197557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93b26-f870-4b5c-81e0-496028ecedaf admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.198217 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef93b26-f870-4b5c-81e0-496028ecedaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.200321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef93b26-f870-4b5c-81e0-496028ecedaf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.214909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 787/1579] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:20.215908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5db86-5078-4af5-9c75-a538b5b5c478 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.226477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5db86-5078-4af5-9c75-a538b5b5c478 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.228129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 793/1580] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:20.228993 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef93b26-f870-4b5c-81e0-496028ecedaf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.231820 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc187-e0b8-41c9-88a2-9b9258e78c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.232449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc187-e0b8-41c9-88a2-9b9258e78c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.232729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc187-e0b8-41c9-88a2-9b9258e78c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.233002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc187-e0b8-41c9-88a2-9b9258e78c3e admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.233656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dc187-e0b8-41c9-88a2-9b9258e78c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.235761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dc187-e0b8-41c9-88a2-9b9258e78c3e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.239363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef93b26-f870-4b5c-81e0-496028ecedaf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.244393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916589-872b-44e3-a434-9bf7c08b0027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.245146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916589-872b-44e3-a434-9bf7c08b0027 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.245434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916589-872b-44e3-a434-9bf7c08b0027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.245707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d916589-872b-44e3-a434-9bf7c08b0027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.246412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d916589-872b-44e3-a434-9bf7c08b0027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.248076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d916589-872b-44e3-a434-9bf7c08b0027 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.265080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 794/1581] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.265278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 788/1582] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:20.265278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc187-e0b8-41c9-88a2-9b9258e78c3e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.265467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916589-872b-44e3-a434-9bf7c08b0027 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.273260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d916589-872b-44e3-a434-9bf7c08b0027 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.278555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9b554-4676-41bd-84a1-d7fe50ddbbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.279208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9b554-4676-41bd-84a1-d7fe50ddbbdc admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.279518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9b554-4676-41bd-84a1-d7fe50ddbbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.279795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9b554-4676-41bd-84a1-d7fe50ddbbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.280510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9b554-4676-41bd-84a1-d7fe50ddbbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.282425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9b554-4676-41bd-84a1-d7fe50ddbbdc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.310868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 795/1583] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:20.314652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9b554-4676-41bd-84a1-d7fe50ddbbdc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.322731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc187-e0b8-41c9-88a2-9b9258e78c3e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.338458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:20.369078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:20.383543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0272b-3a35-40b3-8c6e-7f111bcaf72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.384178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0272b-3a35-40b3-8c6e-7f111bcaf72e service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.384458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0272b-3a35-40b3-8c6e-7f111bcaf72e service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.384733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0272b-3a35-40b3-8c6e-7f111bcaf72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.385425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9b554-4676-41bd-84a1-d7fe50ddbbdc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.390140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d205-0a98-4c54-84c3-02f340f08a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.390929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d205-0a98-4c54-84c3-02f340f08a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.392173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d205-0a98-4c54-84c3-02f340f08a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.392173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d205-0a98-4c54-84c3-02f340f08a57 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.392173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d205-0a98-4c54-84c3-02f340f08a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.393984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d205-0a98-4c54-84c3-02f340f08a57 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.396456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0272b-3a35-40b3-8c6e-7f111bcaf72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.397903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0272b-3a35-40b3-8c6e-7f111bcaf72e service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.409020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 789/1584] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:20.409814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0272b-3a35-40b3-8c6e-7f111bcaf72e service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.420477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0272b-3a35-40b3-8c6e-7f111bcaf72e service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.425437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734895-c9b6-45c9-a2b6-ad97907ea0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.425914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 796/1585] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:20.426203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734895-c9b6-45c9-a2b6-ad97907ea0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.426490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734895-c9b6-45c9-a2b6-ad97907ea0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.426763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734895-c9b6-45c9-a2b6-ad97907ea0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.427499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734895-c9b6-45c9-a2b6-ad97907ea0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.427772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d205-0a98-4c54-84c3-02f340f08a57 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.429248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734895-c9b6-45c9-a2b6-ad97907ea0fc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.441118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 790/1586] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.441260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d205-0a98-4c54-84c3-02f340f08a57 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.442020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734895-c9b6-45c9-a2b6-ad97907ea0fc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.447290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22020856-8237-42b8-a953-a16d56667fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.447934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22020856-8237-42b8-a953-a16d56667fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.448256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22020856-8237-42b8-a953-a16d56667fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.448538 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22020856-8237-42b8-a953-a16d56667fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.449619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22020856-8237-42b8-a953-a16d56667fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.450941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22020856-8237-42b8-a953-a16d56667fc1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.454074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734895-c9b6-45c9-a2b6-ad97907ea0fc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.459802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15188a97-b6fe-4cd2-af42-e3b6968dafd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.460562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15188a97-b6fe-4cd2-af42-e3b6968dafd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.460806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15188a97-b6fe-4cd2-af42-e3b6968dafd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.461006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15188a97-b6fe-4cd2-af42-e3b6968dafd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.462649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15188a97-b6fe-4cd2-af42-e3b6968dafd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.464773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15188a97-b6fe-4cd2-af42-e3b6968dafd7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.469015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 797/1587] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.473276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22020856-8237-42b8-a953-a16d56667fc1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.479473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 791/1588] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.480256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15188a97-b6fe-4cd2-af42-e3b6968dafd7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.489876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22020856-8237-42b8-a953-a16d56667fc1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.491985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15188a97-b6fe-4cd2-af42-e3b6968dafd7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.500072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c23fc5-2d1f-4b96-a29c-3001ed7e1582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.501090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c23fc5-2d1f-4b96-a29c-3001ed7e1582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.501375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c23fc5-2d1f-4b96-a29c-3001ed7e1582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.501644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c23fc5-2d1f-4b96-a29c-3001ed7e1582 admin admin] PATH_INFO: `/v3/projects/a3f526b3a2164c2e9efe858e70cd3a69/users/3264fa6c4cea48ba89955c9bb0c233ab/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.503649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5522-ffe9-4fe1-9db0-8a4dc54836b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.507292 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5522-ffe9-4fe1-9db0-8a4dc54836b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.511458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5522-ffe9-4fe1-9db0-8a4dc54836b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.511891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5522-ffe9-4fe1-9db0-8a4dc54836b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.512654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f5522-ffe9-4fe1-9db0-8a4dc54836b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.514517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f5522-ffe9-4fe1-9db0-8a4dc54836b9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.532176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 792/1589] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.533028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5522-ffe9-4fe1-9db0-8a4dc54836b9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.535733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c23fc5-2d1f-4b96-a29c-3001ed7e1582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f526b3a2164c2e9efe858e70cd3a69, user_id=3264fa6c4cea48ba89955c9bb0c233ab, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.536808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-63c23fc5-2d1f-4b96-a29c-3001ed7e1582 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:40:20.536808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: warnings.warn(msg) Aug 04 04:40:20.536808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: Aug 04 04:40:20.540306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c23fc5-2d1f-4b96-a29c-3001ed7e1582 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.547350 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5522-ffe9-4fe1-9db0-8a4dc54836b9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.553553 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a99fc-d918-4378-a000-91c28ea7c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.554182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a99fc-d918-4378-a000-91c28ea7c3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.554463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a99fc-d918-4378-a000-91c28ea7c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.554838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a99fc-d918-4378-a000-91c28ea7c3b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.555468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a99fc-d918-4378-a000-91c28ea7c3b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.557217 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 798/1590] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:20 2022] PUT /identity/v3/projects/a3f526b3a2164c2e9efe858e70cd3a69/users/3264fa6c4cea48ba89955c9bb0c233ab/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:20.559415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c23fc5-2d1f-4b96-a29c-3001ed7e1582 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.559598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a99fc-d918-4378-a000-91c28ea7c3b9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.591125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 793/1591] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/users => generated 294 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:20.591125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a99fc-d918-4378-a000-91c28ea7c3b9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.609439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a99fc-d918-4378-a000-91c28ea7c3b9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.666911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c23fc5-2d1f-4b96-a29c-3001ed7e1582 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.673209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24585bea-784a-49ff-9aab-e844c2d1dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.673875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24585bea-784a-49ff-9aab-e844c2d1dcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.674138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24585bea-784a-49ff-9aab-e844c2d1dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.674411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24585bea-784a-49ff-9aab-e844c2d1dcf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.675179 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24585bea-784a-49ff-9aab-e844c2d1dcf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.676808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24585bea-784a-49ff-9aab-e844c2d1dcf0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.684648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785613-3324-4d82-816d-a0f8f649bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.685592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785613-3324-4d82-816d-a0f8f649bf75 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.686223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785613-3324-4d82-816d-a0f8f649bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.686697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785613-3324-4d82-816d-a0f8f649bf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.687641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785613-3324-4d82-816d-a0f8f649bf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.688559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 799/1592] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.689422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24585bea-784a-49ff-9aab-e844c2d1dcf0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.690123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785613-3324-4d82-816d-a0f8f649bf75 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.701928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 794/1593] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.702794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785613-3324-4d82-816d-a0f8f649bf75 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.703831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24585bea-784a-49ff-9aab-e844c2d1dcf0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.709735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61686d-e078-46ba-99ed-332648797cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.710374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61686d-e078-46ba-99ed-332648797cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.711393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61686d-e078-46ba-99ed-332648797cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.711393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61686d-e078-46ba-99ed-332648797cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.712067 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61686d-e078-46ba-99ed-332648797cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.712964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785613-3324-4d82-816d-a0f8f649bf75 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.713793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61686d-e078-46ba-99ed-332648797cf7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.718834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a4e16-1332-4500-8395-ae33462402c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.719514 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4e16-1332-4500-8395-ae33462402c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.719796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4e16-1332-4500-8395-ae33462402c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.720069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4e16-1332-4500-8395-ae33462402c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.720778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a4e16-1332-4500-8395-ae33462402c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.722383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a4e16-1332-4500-8395-ae33462402c9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.729303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 800/1594] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.729303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61686d-e078-46ba-99ed-332648797cf7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.737599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 795/1595] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.739136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21675c85-67fd-415a-8d6a-8ac7145f19a0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.739486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21675c85-67fd-415a-8d6a-8ac7145f19a0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.739826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21675c85-67fd-415a-8d6a-8ac7145f19a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.746262 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61686d-e078-46ba-99ed-332648797cf7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.752204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a127e-dbdf-4315-97c5-6bb6b2ada1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.752637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a127e-dbdf-4315-97c5-6bb6b2ada1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.752924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a127e-dbdf-4315-97c5-6bb6b2ada1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.753198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a127e-dbdf-4315-97c5-6bb6b2ada1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.753903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a127e-dbdf-4315-97c5-6bb6b2ada1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.759248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a127e-dbdf-4315-97c5-6bb6b2ada1ed admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.765324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-21675c85-67fd-415a-8d6a-8ac7145f19a0 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:20.766565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-21675c85-67fd-415a-8d6a-8ac7145f19a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:20.777828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 801/1596] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.778064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 796/1597] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:20.778064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21675c85-67fd-415a-8d6a-8ac7145f19a0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.784428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a127e-dbdf-4315-97c5-6bb6b2ada1ed admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.787661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21675c85-67fd-415a-8d6a-8ac7145f19a0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.792775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1cd0-582a-4c6a-926f-aa5653a55c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.793408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1cd0-582a-4c6a-926f-aa5653a55c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.793931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1cd0-582a-4c6a-926f-aa5653a55c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.793931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1cd0-582a-4c6a-926f-aa5653a55c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.794636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c1cd0-582a-4c6a-926f-aa5653a55c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.796281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c1cd0-582a-4c6a-926f-aa5653a55c71 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.798501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a127e-dbdf-4315-97c5-6bb6b2ada1ed admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.803367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891c724-32ac-4758-b26c-7c8a58329976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.804151 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891c724-32ac-4758-b26c-7c8a58329976 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.804340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891c724-32ac-4758-b26c-7c8a58329976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.805409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891c724-32ac-4758-b26c-7c8a58329976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.806758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891c724-32ac-4758-b26c-7c8a58329976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.815284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 797/1598] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.815284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1cd0-582a-4c6a-926f-aa5653a55c71 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.815593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891c724-32ac-4758-b26c-7c8a58329976 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.824251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1cd0-582a-4c6a-926f-aa5653a55c71 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.829773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 802/1599] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:20.829773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891c724-32ac-4758-b26c-7c8a58329976 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.846011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891c724-32ac-4758-b26c-7c8a58329976 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:20.856734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226bb1b-654b-48e1-8f6a-8f48fc648e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.857436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226bb1b-654b-48e1-8f6a-8f48fc648e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.857723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226bb1b-654b-48e1-8f6a-8f48fc648e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.857989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226bb1b-654b-48e1-8f6a-8f48fc648e3c admin admin] PATH_INFO: `/v3/projects/c4c1980482ac408fb5c52e41d0819409/users/76791dc5fbdf4c61919308cd1eaf91fb/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.858173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7f732-c594-4d87-bc10-d82f5e395621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:20.859274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7f732-c594-4d87-bc10-d82f5e395621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:20.859775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7f732-c594-4d87-bc10-d82f5e395621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:20.860501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7f732-c594-4d87-bc10-d82f5e395621 admin admin] PATH_INFO: `/v3/projects/307abeafeca74689adfa01a7ae804700/users/0a1e2409e3df40668c2ddbb6800ab7f7/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:20.891680 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7f732-c594-4d87-bc10-d82f5e395621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307abeafeca74689adfa01a7ae804700, user_id=0a1e2409e3df40668c2ddbb6800ab7f7, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.895374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7f732-c594-4d87-bc10-d82f5e395621 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.899491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226bb1b-654b-48e1-8f6a-8f48fc648e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c1980482ac408fb5c52e41d0819409, user_id=76791dc5fbdf4c61919308cd1eaf91fb, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:20.904137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226bb1b-654b-48e1-8f6a-8f48fc648e3c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:20.915183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 803/1600] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:20 2022] PUT /identity/v3/projects/307abeafeca74689adfa01a7ae804700/users/0a1e2409e3df40668c2ddbb6800ab7f7/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:20.916570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7f732-c594-4d87-bc10-d82f5e395621 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.930896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 798/1601] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:20 2022] PUT /identity/v3/projects/c4c1980482ac408fb5c52e41d0819409/users/76791dc5fbdf4c61919308cd1eaf91fb/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:20.932695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226bb1b-654b-48e1-8f6a-8f48fc648e3c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:20.962724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:20.975794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:20.999536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7f732-c594-4d87-bc10-d82f5e395621 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:21.033902 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226bb1b-654b-48e1-8f6a-8f48fc648e3c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:21.042555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a55cf-48f2-4f56-a486-dbf1a0f0a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:21.043652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a55cf-48f2-4f56-a486-dbf1a0f0a148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.044024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a55cf-48f2-4f56-a486-dbf1a0f0a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.044363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a55cf-48f2-4f56-a486-dbf1a0f0a148 admin admin] PATH_INFO: `/v3/projects/8e3b8b3604174dba9436582a15895f28/users/caa013b096714c1f8053c6aeceb335d9/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.073794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a55cf-48f2-4f56-a486-dbf1a0f0a148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3b8b3604174dba9436582a15895f28, user_id=caa013b096714c1f8053c6aeceb335d9, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:21.076695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a55cf-48f2-4f56-a486-dbf1a0f0a148 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:21.085183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06b3e-8985-4d52-a2d8-9899779726f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:21.086463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06b3e-8985-4d52-a2d8-9899779726f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.086838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06b3e-8985-4d52-a2d8-9899779726f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.087216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06b3e-8985-4d52-a2d8-9899779726f5 admin admin] PATH_INFO: `/v3/projects/f71ff1d01f654b4a93ea43a3f18bc618/users/d6a6f20d09bc4d5abc7c2a7fc02376b7/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.093176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 799/1602] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:20 2022] PUT /identity/v3/projects/8e3b8b3604174dba9436582a15895f28/users/caa013b096714c1f8053c6aeceb335d9/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:21.093830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a55cf-48f2-4f56-a486-dbf1a0f0a148 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:21.096221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-df5a55cf-48f2-4f56-a486-dbf1a0f0a148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:21.106399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db06b3e-8985-4d52-a2d8-9899779726f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71ff1d01f654b4a93ea43a3f18bc618, user_id=d6a6f20d09bc4d5abc7c2a7fc02376b7, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:21.109199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db06b3e-8985-4d52-a2d8-9899779726f5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:21.130761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 804/1603] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:20 2022] PUT /identity/v3/projects/f71ff1d01f654b4a93ea43a3f18bc618/users/d6a6f20d09bc4d5abc7c2a7fc02376b7/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:21.130761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06b3e-8985-4d52-a2d8-9899779726f5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:21.197026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a55cf-48f2-4f56-a486-dbf1a0f0a148 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:21.235853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06b3e-8985-4d52-a2d8-9899779726f5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:21.245409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e980-3ae2-4a92-90c0-744e4ec78bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:21.246715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e980-3ae2-4a92-90c0-744e4ec78bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.247054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e980-3ae2-4a92-90c0-744e4ec78bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.247712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e980-3ae2-4a92-90c0-744e4ec78bd8 admin admin] PATH_INFO: `/v3/projects/480dab9974de4df3a01cad7599cf5ef7/users/9b81437d270f4001a59b433e529146f4/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.270220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e980-3ae2-4a92-90c0-744e4ec78bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480dab9974de4df3a01cad7599cf5ef7, user_id=9b81437d270f4001a59b433e529146f4, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:21.275537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e980-3ae2-4a92-90c0-744e4ec78bd8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:21.288458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca796f5d-74d5-483c-9908-f35a894f3c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:21.289821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca796f5d-74d5-483c-9908-f35a894f3c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.290135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca796f5d-74d5-483c-9908-f35a894f3c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.290451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca796f5d-74d5-483c-9908-f35a894f3c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.302175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca796f5d-74d5-483c-9908-f35a894f3c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:21.302487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 805/1604] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:21 2022] PUT /identity/v3/projects/480dab9974de4df3a01cad7599cf5ef7/users/9b81437d270f4001a59b433e529146f4/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:21.303606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca796f5d-74d5-483c-9908-f35a894f3c93 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:21.304149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e980-3ae2-4a92-90c0-744e4ec78bd8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:21.316799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 800/1605] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:21.318293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5aa7-5783-4297-9f92-0a2c24ede2bf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.318581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5aa7-5783-4297-9f92-0a2c24ede2bf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.318864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5aa7-5783-4297-9f92-0a2c24ede2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.341211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5b6d5aa7-5783-4297-9f92-0a2c24ede2bf None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:21.342440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5b6d5aa7-5783-4297-9f92-0a2c24ede2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:21.401705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:21.409083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:21.426898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e980-3ae2-4a92-90c0-744e4ec78bd8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:21.429940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 801/1606] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:21.431545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6e45-b839-49c5-9cc5-d664ad7c402a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.431835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6e45-b839-49c5-9cc5-d664ad7c402a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.432116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6e45-b839-49c5-9cc5-d664ad7c402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.440555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f9d1-a2f3-4a7c-bf9b-89f804150b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:21.441293 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f9d1-a2f3-4a7c-bf9b-89f804150b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.443363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f9d1-a2f3-4a7c-bf9b-89f804150b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.443791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f9d1-a2f3-4a7c-bf9b-89f804150b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.444724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f9d1-a2f3-4a7c-bf9b-89f804150b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:21.446610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f9d1-a2f3-4a7c-bf9b-89f804150b2c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:21.469097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 806/1607] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:21.469097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b151-067a-4f26-808d-8e46c6eac0ee None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.469097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b151-067a-4f26-808d-8e46c6eac0ee None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.469097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b151-067a-4f26-808d-8e46c6eac0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.470596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b4ac6e45-b839-49c5-9cc5-d664ad7c402a None None] MFA Rules not processed for user `76791dc5fbdf4c61919308cd1eaf91fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:21.472413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b4ac6e45-b839-49c5-9cc5-d664ad7c402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:21.513164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1a23b151-067a-4f26-808d-8e46c6eac0ee None None] MFA Rules not processed for user `caa013b096714c1f8053c6aeceb335d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:21.516239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1a23b151-067a-4f26-808d-8e46c6eac0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:21.564231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 802/1608] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:21.565674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06fb5a-f6d8-415b-989d-5e5a7853d141 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.566255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06fb5a-f6d8-415b-989d-5e5a7853d141 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.566671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06fb5a-f6d8-415b-989d-5e5a7853d141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.596886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ea06fb5a-f6d8-415b-989d-5e5a7853d141 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:21.598470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ea06fb5a-f6d8-415b-989d-5e5a7853d141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:21.617565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 803/1609] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:21.617565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453924ae-7c4b-455f-8f5c-6aa9f67ecc10 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.622708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453924ae-7c4b-455f-8f5c-6aa9f67ecc10 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.626104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453924ae-7c4b-455f-8f5c-6aa9f67ecc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.641553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 807/1610] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:21.641553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b151-067a-4f26-808d-8e46c6eac0ee None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:21.701354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-453924ae-7c4b-455f-8f5c-6aa9f67ecc10 None None] MFA Rules not processed for user `9b81437d270f4001a59b433e529146f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:21.703812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-453924ae-7c4b-455f-8f5c-6aa9f67ecc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:21.755248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b151-067a-4f26-808d-8e46c6eac0ee None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:21.759997 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172326de-388e-4bd2-a087-2f17e08c9598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:21.761035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172326de-388e-4bd2-a087-2f17e08c9598 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.761456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172326de-388e-4bd2-a087-2f17e08c9598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.761828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172326de-388e-4bd2-a087-2f17e08c9598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.779092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172326de-388e-4bd2-a087-2f17e08c9598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:21.781962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172326de-388e-4bd2-a087-2f17e08c9598 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:21.801590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 804/1611] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:21.802128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 808/1612] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:21.802128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172326de-388e-4bd2-a087-2f17e08c9598 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:21.807826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453924ae-7c4b-455f-8f5c-6aa9f67ecc10 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:21.836029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453924ae-7c4b-455f-8f5c-6aa9f67ecc10 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:21.847352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aef1a-0ee5-44fa-992d-33a90a9271dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:21.851205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aef1a-0ee5-44fa-992d-33a90a9271dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.852227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aef1a-0ee5-44fa-992d-33a90a9271dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.853734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9aef1a-0ee5-44fa-992d-33a90a9271dd admin admin] PATH_INFO: `/v3/projects/b12338cdc42447d6a47bd6769daf7a99/users/5323045e825c4b32863e2aff07743288/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.854094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172326de-388e-4bd2-a087-2f17e08c9598 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:21.884867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042ac3c-0eaa-491c-95b6-a102d7996b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:21.886775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042ac3c-0eaa-491c-95b6-a102d7996b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.887123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042ac3c-0eaa-491c-95b6-a102d7996b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.887403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042ac3c-0eaa-491c-95b6-a102d7996b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:21.888225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042ac3c-0eaa-491c-95b6-a102d7996b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:21.896722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042ac3c-0eaa-491c-95b6-a102d7996b1d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:21.898610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9aef1a-0ee5-44fa-992d-33a90a9271dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12338cdc42447d6a47bd6769daf7a99, user_id=5323045e825c4b32863e2aff07743288, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:21.901667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9aef1a-0ee5-44fa-992d-33a90a9271dd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:21.946522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 805/1613] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:21 2022] PUT /identity/v3/projects/b12338cdc42447d6a47bd6769daf7a99/users/5323045e825c4b32863e2aff07743288/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:21.947550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aef1a-0ee5-44fa-992d-33a90a9271dd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:21.985537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 809/1614] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:21 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:21.993208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca297d-a81e-4d11-9ec9-d631d1ead844 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:21.993957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca297d-a81e-4d11-9ec9-d631d1ead844 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:21.994451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca297d-a81e-4d11-9ec9-d631d1ead844 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:22.004651 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 810/1615] 10.222.0.57 () {54 vars in 962 bytes} [Thu Aug 4 04:40:21 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:40:22.007344 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7d381-535f-4046-afb0-17ff4b7a5cd1 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:22.007909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7d381-535f-4046-afb0-17ff4b7a5cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:22.008400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7d381-535f-4046-afb0-17ff4b7a5cd1 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:22.010537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 811/1616] 10.222.0.57 () {54 vars in 962 bytes} [Thu Aug 4 04:40:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:40:22.012029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736734bb-67a4-44de-8c36-5ac86b554b33 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:22.012630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736734bb-67a4-44de-8c36-5ac86b554b33 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:22.013107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736734bb-67a4-44de-8c36-5ac86b554b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:22.069277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-736734bb-67a4-44de-8c36-5ac86b554b33 None None] MFA Rules not processed for user `5323045e825c4b32863e2aff07743288`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:22.070951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-736734bb-67a4-44de-8c36-5ac86b554b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:22.074776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:22.100214 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9aef1a-0ee5-44fa-992d-33a90a9271dd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:22.172892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:22.215914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768fb7a-c395-4430-9be7-958bb4b38a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:22.216833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768fb7a-c395-4430-9be7-958bb4b38a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:22.217172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768fb7a-c395-4430-9be7-958bb4b38a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:22.217454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768fb7a-c395-4430-9be7-958bb4b38a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:22.227984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 812/1617] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:22.229065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736734bb-67a4-44de-8c36-5ac86b554b33 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:22.360598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768fb7a-c395-4430-9be7-958bb4b38a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:22.364013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768fb7a-c395-4430-9be7-958bb4b38a21 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:22.393658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 806/1618] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:22.395855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad03277-16c4-4b4e-8d75-a9bce3b5e449 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:22.396433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad03277-16c4-4b4e-8d75-a9bce3b5e449 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:22.396654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad03277-16c4-4b4e-8d75-a9bce3b5e449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:22.550245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bad03277-16c4-4b4e-8d75-a9bce3b5e449 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:22.550245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bad03277-16c4-4b4e-8d75-a9bce3b5e449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:22.566794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736734bb-67a4-44de-8c36-5ac86b554b33 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:22.589688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ac633-e2a9-4f64-ac75-236db2809ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:22.590228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac633-e2a9-4f64-ac75-236db2809ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:22.590503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac633-e2a9-4f64-ac75-236db2809ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:22.590779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ac633-e2a9-4f64-ac75-236db2809ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:22.592447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ac633-e2a9-4f64-ac75-236db2809ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:22.594454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ac633-e2a9-4f64-ac75-236db2809ebf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:22.653260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 813/1619] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:22 2022] POST /identity/v3/users => generated 291 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:22.653260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5191c-0af2-4487-8cfd-0f5f6953b488 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:22.653260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5191c-0af2-4487-8cfd-0f5f6953b488 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:22.653260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5191c-0af2-4487-8cfd-0f5f6953b488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:22.703487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9eb5191c-0af2-4487-8cfd-0f5f6953b488 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:22.705062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9eb5191c-0af2-4487-8cfd-0f5f6953b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:22.709475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 807/1620] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Aug 4 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:22.710875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad03277-16c4-4b4e-8d75-a9bce3b5e449 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:22.726347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad03277-16c4-4b4e-8d75-a9bce3b5e449 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:22.727673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 814/1621] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Aug 4 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:22.729758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5191c-0af2-4487-8cfd-0f5f6953b488 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:22.740481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c703db0-e49a-44b9-9a70-dd36f87a19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:22.741190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c703db0-e49a-44b9-9a70-dd36f87a19d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:22.741999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c703db0-e49a-44b9-9a70-dd36f87a19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:22.743162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5191c-0af2-4487-8cfd-0f5f6953b488 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:22.744652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c703db0-e49a-44b9-9a70-dd36f87a19d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:22.747204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c703db0-e49a-44b9-9a70-dd36f87a19d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:22.752344 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0312-61e9-4bd5-b783-edf31833f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:22.754603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0312-61e9-4bd5-b783-edf31833f711 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:22.754603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0312-61e9-4bd5-b783-edf31833f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:22.754603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0312-61e9-4bd5-b783-edf31833f711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:22.754603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f0312-61e9-4bd5-b783-edf31833f711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:22.757709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c703db0-e49a-44b9-9a70-dd36f87a19d9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:22.761779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f0312-61e9-4bd5-b783-edf31833f711 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:22.797131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 815/1622] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:22.805482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0312-61e9-4bd5-b783-edf31833f711 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:22.821651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 808/1623] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:22 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:22.822818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c703db0-e49a-44b9-9a70-dd36f87a19d9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:22.840583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0312-61e9-4bd5-b783-edf31833f711 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:22.845568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:22.976132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bd6be-5bfe-4323-b42d-59fd25325ce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:22.981629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bd6be-5bfe-4323-b42d-59fd25325ce5 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:22.982049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bd6be-5bfe-4323-b42d-59fd25325ce5 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:22.982394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bd6be-5bfe-4323-b42d-59fd25325ce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.023774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c703db0-e49a-44b9-9a70-dd36f87a19d9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:23.032938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b41dbb-198c-4db4-9cae-dac62639e550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:23.033892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b41dbb-198c-4db4-9cae-dac62639e550 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:23.034011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b41dbb-198c-4db4-9cae-dac62639e550 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:23.034248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b41dbb-198c-4db4-9cae-dac62639e550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.115127 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bd6be-5bfe-4323-b42d-59fd25325ce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:23.116935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bd6be-5bfe-4323-b42d-59fd25325ce5 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:23.128035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:23.147724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 816/1624] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:23.148640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b41dbb-198c-4db4-9cae-dac62639e550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:23.149761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bd6be-5bfe-4323-b42d-59fd25325ce5 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:23.152189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b41dbb-198c-4db4-9cae-dac62639e550 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:23.170295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 809/1625] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:23.171234 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b41dbb-198c-4db4-9cae-dac62639e550 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:23.331306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b41dbb-198c-4db4-9cae-dac62639e550 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:23.338876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bd6be-5bfe-4323-b42d-59fd25325ce5 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:23.350050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354170cf-e08f-41df-9f23-a178cb33a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:23.352899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354170cf-e08f-41df-9f23-a178cb33a975 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:23.370130 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354170cf-e08f-41df-9f23-a178cb33a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:23.373115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354170cf-e08f-41df-9f23-a178cb33a975 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.373809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d6231-e845-4356-b95a-22e50449fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:23.379136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d6231-e845-4356-b95a-22e50449fc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:23.379564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d6231-e845-4356-b95a-22e50449fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:23.379946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d6231-e845-4356-b95a-22e50449fc9f admin admin] PATH_INFO: `/v3/projects/3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3/users/cd80e3c6826b400f8676a86047ba3d86/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.380611 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354170cf-e08f-41df-9f23-a178cb33a975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:23.383142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354170cf-e08f-41df-9f23-a178cb33a975 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:23.433474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d6231-e845-4356-b95a-22e50449fc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3, user_id=cd80e3c6826b400f8676a86047ba3d86, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:23.439947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d6231-e845-4356-b95a-22e50449fc9f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:23.443475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 810/1626] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:23 2022] POST /identity/v3/users => generated 300 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:23.444448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354170cf-e08f-41df-9f23-a178cb33a975 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:23.458896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354170cf-e08f-41df-9f23-a178cb33a975 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:23.475821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 817/1627] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:23 2022] PUT /identity/v3/projects/3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3/users/cd80e3c6826b400f8676a86047ba3d86/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:23.477603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b0ef5-ba37-434d-ab21-eecc787565be None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:23.479996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b0ef5-ba37-434d-ab21-eecc787565be None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:23.480417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b0ef5-ba37-434d-ab21-eecc787565be None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.488238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 818/1628] 10.222.0.57 () {54 vars in 912 bytes} [Thu Aug 4 04:40:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:40:23.489462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b0ef5-ba37-434d-ab21-eecc787565be None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:23.515733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:23.574385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d665ce-d0b0-4b6d-8b7d-23ed8b7f21a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:23.575081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d665ce-d0b0-4b6d-8b7d-23ed8b7f21a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:23.575608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d665ce-d0b0-4b6d-8b7d-23ed8b7f21a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:23.575893 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d665ce-d0b0-4b6d-8b7d-23ed8b7f21a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.577478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d665ce-d0b0-4b6d-8b7d-23ed8b7f21a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:23.599070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b0ef5-ba37-434d-ab21-eecc787565be None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:23.607710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30177b-bbb8-4771-a039-79b320458c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:23.608677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30177b-bbb8-4771-a039-79b320458c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:23.609094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30177b-bbb8-4771-a039-79b320458c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:23.609491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30177b-bbb8-4771-a039-79b320458c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.613425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30177b-bbb8-4771-a039-79b320458c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:23.616416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d665ce-d0b0-4b6d-8b7d-23ed8b7f21a7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:23.623319 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30177b-bbb8-4771-a039-79b320458c61 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:23.651842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 811/1629] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:23.653278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd85a3-39d6-424f-bec6-353fb9b2d154 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:23.653574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd85a3-39d6-424f-bec6-353fb9b2d154 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:23.653854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd85a3-39d6-424f-bec6-353fb9b2d154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.654764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 819/1630] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:23.667157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30177b-bbb8-4771-a039-79b320458c61 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:23.685321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30177b-bbb8-4771-a039-79b320458c61 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:23.690589 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-10fd85a3-39d6-424f-bec6-353fb9b2d154 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:23.692954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-10fd85a3-39d6-424f-bec6-353fb9b2d154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:23.706479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3c4de-6955-4eeb-9c25-68efd297862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:23.707244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3c4de-6955-4eeb-9c25-68efd297862f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:23.707627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3c4de-6955-4eeb-9c25-68efd297862f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:23.707790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3c4de-6955-4eeb-9c25-68efd297862f admin admin] PATH_INFO: `/v3/projects/49211a32815244cda14ce201f13041c6/users/3c5fb7f17d074b8ba9d5a10b2e2f9c71/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.767225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3c4de-6955-4eeb-9c25-68efd297862f admin admin] RBAC: Authorizing `identity:create_grant(project_id=49211a32815244cda14ce201f13041c6, user_id=3c5fb7f17d074b8ba9d5a10b2e2f9c71, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:23.773720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3c4de-6955-4eeb-9c25-68efd297862f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:23.806889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 820/1631] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:23 2022] PUT /identity/v3/projects/49211a32815244cda14ce201f13041c6/users/3c5fb7f17d074b8ba9d5a10b2e2f9c71/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:23.806889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3c4de-6955-4eeb-9c25-68efd297862f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:23.898318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 812/1632] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:40:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:23.899778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd85a3-39d6-424f-bec6-353fb9b2d154 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:23.911959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd85a3-39d6-424f-bec6-353fb9b2d154 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:23.946226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:23.954475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3c4de-6955-4eeb-9c25-68efd297862f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:23.962346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af813c-ffff-47ef-bc40-c731876ad5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:23.963578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af813c-ffff-47ef-bc40-c731876ad5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:23.963875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af813c-ffff-47ef-bc40-c731876ad5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:23.964486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af813c-ffff-47ef-bc40-c731876ad5b4 admin admin] PATH_INFO: `/v3/projects/3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3/users/cd80e3c6826b400f8676a86047ba3d86/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:23.967102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af813c-ffff-47ef-bc40-c731876ad5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3, user_id=cd80e3c6826b400f8676a86047ba3d86, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:23.971847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af813c-ffff-47ef-bc40-c731876ad5b4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:24.001231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 821/1633] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:23 2022] PUT /identity/v3/projects/3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3/users/cd80e3c6826b400f8676a86047ba3d86/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:24.001231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67c660-09a2-4882-8457-9de037e60f3d None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:24.001231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67c660-09a2-4882-8457-9de037e60f3d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:24.001231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67c660-09a2-4882-8457-9de037e60f3d None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:24.001231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 822/1634] 10.222.0.57 () {54 vars in 912 bytes} [Thu Aug 4 04:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:40:24.001231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67c660-09a2-4882-8457-9de037e60f3d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:24.054915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2f0f1-0b8d-4d7d-8ec2-4057dcf40fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:24.055872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f0f1-0b8d-4d7d-8ec2-4057dcf40fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:24.056317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f0f1-0b8d-4d7d-8ec2-4057dcf40fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:24.056839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2f0f1-0b8d-4d7d-8ec2-4057dcf40fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:24.057698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2f0f1-0b8d-4d7d-8ec2-4057dcf40fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:24.059737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2f0f1-0b8d-4d7d-8ec2-4057dcf40fb5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:24.084002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 813/1635] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:24.086733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c93a-b9c9-46ed-9699-0a7cf282fed5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:24.087475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c93a-b9c9-46ed-9699-0a7cf282fed5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:24.089797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242c93a-b9c9-46ed-9699-0a7cf282fed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:24.124339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67c660-09a2-4882-8457-9de037e60f3d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:24.132380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16f661-1333-4378-9897-a8cdbd59fc06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:24.134917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f661-1333-4378-9897-a8cdbd59fc06 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:24.135218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f661-1333-4378-9897-a8cdbd59fc06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:24.135980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f661-1333-4378-9897-a8cdbd59fc06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:24.142238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7242c93a-b9c9-46ed-9699-0a7cf282fed5 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:24.143454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7242c93a-b9c9-46ed-9699-0a7cf282fed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:24.263092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:24.308514 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 814/1636] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:24.310170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deace84-d361-4a88-9909-f6037d66f433 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:24.311610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deace84-d361-4a88-9909-f6037d66f433 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:24.312296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deace84-d361-4a88-9909-f6037d66f433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:24.319142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16f661-1333-4378-9897-a8cdbd59fc06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:24.321056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16f661-1333-4378-9897-a8cdbd59fc06 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:24.369305 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 823/1637] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:24.370516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16f661-1333-4378-9897-a8cdbd59fc06 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:24.416395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6deace84-d361-4a88-9909-f6037d66f433 None None] MFA Rules not processed for user `cd80e3c6826b400f8676a86047ba3d86`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:24.419730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6deace84-d361-4a88-9909-f6037d66f433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:24.570971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16f661-1333-4378-9897-a8cdbd59fc06 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:24.588126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 815/1638] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:24.589460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deace84-d361-4a88-9909-f6037d66f433 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:24.596164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01825a1-bed0-41d0-8c56-d3562cf5c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:24.596164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01825a1-bed0-41d0-8c56-d3562cf5c436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:24.596482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01825a1-bed0-41d0-8c56-d3562cf5c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:24.598013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01825a1-bed0-41d0-8c56-d3562cf5c436 admin admin] PATH_INFO: `/v3/projects/49211a32815244cda14ce201f13041c6/users/3c5fb7f17d074b8ba9d5a10b2e2f9c71/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:24.603594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01825a1-bed0-41d0-8c56-d3562cf5c436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49211a32815244cda14ce201f13041c6, user_id=3c5fb7f17d074b8ba9d5a10b2e2f9c71, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:24.603811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deace84-d361-4a88-9909-f6037d66f433 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:24.608835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01825a1-bed0-41d0-8c56-d3562cf5c436 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:24.612230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d9d6-0afd-4e90-b0bb-442e2bf4c6a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:24.613129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d9d6-0afd-4e90-b0bb-442e2bf4c6a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:24.613356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d9d6-0afd-4e90-b0bb-442e2bf4c6a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:24.613683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d9d6-0afd-4e90-b0bb-442e2bf4c6a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:24.627507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d9d6-0afd-4e90-b0bb-442e2bf4c6a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:24.629526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d9d6-0afd-4e90-b0bb-442e2bf4c6a0 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:24.637627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 824/1639] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:24 2022] PUT /identity/v3/projects/49211a32815244cda14ce201f13041c6/users/3c5fb7f17d074b8ba9d5a10b2e2f9c71/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:24.649004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5326-c0af-48ad-9776-0bde991c3e05 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:24.649228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5326-c0af-48ad-9776-0bde991c3e05 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:24.649423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5326-c0af-48ad-9776-0bde991c3e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:24.659533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 816/1640] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:24.717513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c4db5326-c0af-48ad-9776-0bde991c3e05 None None] MFA Rules not processed for user `3c5fb7f17d074b8ba9d5a10b2e2f9c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:24.729670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c4db5326-c0af-48ad-9776-0bde991c3e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:24.770330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:24.942084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 825/1641] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:40:25.382433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d9d6-0afd-4e90-b0bb-442e2bf4c6a0 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:25.433170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d9d6-0afd-4e90-b0bb-442e2bf4c6a0 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:25.583921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cda31b-f1c2-43cd-bf31-b167b4a5f844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:25.584982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cda31b-f1c2-43cd-bf31-b167b4a5f844 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:25.585466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cda31b-f1c2-43cd-bf31-b167b4a5f844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:25.585977 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cda31b-f1c2-43cd-bf31-b167b4a5f844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:25.706207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5326-c0af-48ad-9776-0bde991c3e05 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:25.730326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5326-c0af-48ad-9776-0bde991c3e05 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:25.732015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cda31b-f1c2-43cd-bf31-b167b4a5f844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:25.737521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cda31b-f1c2-43cd-bf31-b167b4a5f844 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:25.750374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc04f57-9ef2-437d-95d7-3d33c0e2b7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:25.752026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc04f57-9ef2-437d-95d7-3d33c0e2b7ff service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:25.752539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc04f57-9ef2-437d-95d7-3d33c0e2b7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:25.752972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc04f57-9ef2-437d-95d7-3d33c0e2b7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:25.784169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 817/1642] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:25.804188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc04f57-9ef2-437d-95d7-3d33c0e2b7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:25.816103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc04f57-9ef2-437d-95d7-3d33c0e2b7ff service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:25.874555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 826/1643] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:40:26.112938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cda31b-f1c2-43cd-bf31-b167b4a5f844 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:26.138581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cda31b-f1c2-43cd-bf31-b167b4a5f844 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:26.182549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0c5bb-8e9c-4bc2-9264-01c8358e94e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:26.187256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0c5bb-8e9c-4bc2-9264-01c8358e94e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:26.187588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0c5bb-8e9c-4bc2-9264-01c8358e94e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:26.187932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0c5bb-8e9c-4bc2-9264-01c8358e94e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:26.216256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:26.355472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0c5bb-8e9c-4bc2-9264-01c8358e94e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:26.357817 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0c5bb-8e9c-4bc2-9264-01c8358e94e4 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:26.379833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc04f57-9ef2-437d-95d7-3d33c0e2b7ff service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:26.380287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 818/1644] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:26.533616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc04f57-9ef2-437d-95d7-3d33c0e2b7ff service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:26.549971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:26.550938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:26.551347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:26.551726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] PATH_INFO: `/v3/users/5323045e825c4b32863e2aff07743288` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:26.554230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5323045e825c4b32863e2aff07743288)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:26.555969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: WARNING py.warnings [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:40:26.555969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: warnings.warn(msg) Aug 04 04:40:26.555969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: Aug 04 04:40:26.557683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:26.665325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5323045e825c4b32863e2aff07743288'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:26.666528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5323045e825c4b32863e2aff07743288'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:26.714460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5323045e825c4b32863e2aff07743288'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:26.762312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5323045e825c4b32863e2aff07743288'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:26.780027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5323045e825c4b32863e2aff07743288'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:26.798745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 827/1645] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:26 2022] DELETE /identity/v3/users/5323045e825c4b32863e2aff07743288 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:26.800190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033cc4-6ddf-41f5-9127-de795569070e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:26.800657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033cc4-6ddf-41f5-9127-de795569070e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:26.800754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5033cc4-6ddf-41f5-9127-de795569070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:26.831002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c5033cc4-6ddf-41f5-9127-de795569070e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:26.836517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c5033cc4-6ddf-41f5-9127-de795569070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:26.991358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 819/1646] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:40:27.010506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:27.011991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:27.061439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:27.186923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d2e40-5881-4d37-a8f4-f287ec6023cb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:27.192452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a687-b623-4b26-9e4c-301c9c0474f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:27.193113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a687-b623-4b26-9e4c-301c9c0474f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:27.193392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a687-b623-4b26-9e4c-301c9c0474f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:27.193664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9a687-b623-4b26-9e4c-301c9c0474f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:27.205347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9a687-b623-4b26-9e4c-301c9c0474f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:27.216850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9a687-b623-4b26-9e4c-301c9c0474f6 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:27.248868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 828/1647] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:28.702105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033cc4-6ddf-41f5-9127-de795569070e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:28.705415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c5033cc4-6ddf-41f5-9127-de795569070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:28.744397 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5033cc4-6ddf-41f5-9127-de795569070e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:28.777205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:28.780362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:28.780676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:28.781001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] PATH_INFO: `/v3/projects/b12338cdc42447d6a47bd6769daf7a99` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:28.784195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12338cdc42447d6a47bd6769daf7a99)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:28.785260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: WARNING py.warnings [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 04:40:28.785260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: warnings.warn(msg) Aug 04 04:40:28.785260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: Aug 04 04:40:28.786482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:28.960556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12338cdc42447d6a47bd6769daf7a99', 'request_id': 'req-f28093d4-a9ec-40f8-8b1e-8c77385266a1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:28.982732 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12338cdc42447d6a47bd6769daf7a99', 'request_id': 'req-f28093d4-a9ec-40f8-8b1e-8c77385266a1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:28.999916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12338cdc42447d6a47bd6769daf7a99', 'request_id': 'req-f28093d4-a9ec-40f8-8b1e-8c77385266a1'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.095377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] The token cache is being invalidate because project b12338cdc42447d6a47bd6769daf7a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:29.095866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.117503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.122672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 820/1648] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:28 2022] DELETE /identity/v3/projects/b12338cdc42447d6a47bd6769daf7a99 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:29.128075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a687-b623-4b26-9e4c-301c9c0474f6 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:29.150114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9a687-b623-4b26-9e4c-301c9c0474f6 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:29.202054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:29.204085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:29.310081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:29.367173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:29.369190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:29.371891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:29.372180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] PATH_INFO: `/v3/users/3c5fb7f17d074b8ba9d5a10b2e2f9c71` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:29.376416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5fb7f17d074b8ba9d5a10b2e2f9c71)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:29.378428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:29.479917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28093d4-a9ec-40f8-8b1e-8c77385266a1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:29.499070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:29.499959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:29.500375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:29.500812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] PATH_INFO: `/v3/users/9b81437d270f4001a59b433e529146f4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:29.502317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b81437d270f4001a59b433e529146f4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:29.515730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:29.623697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5fb7f17d074b8ba9d5a10b2e2f9c71'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.625282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5fb7f17d074b8ba9d5a10b2e2f9c71'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.657417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5fb7f17d074b8ba9d5a10b2e2f9c71'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.681556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5fb7f17d074b8ba9d5a10b2e2f9c71'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.698630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-674ab919-35b2-425b-bb9f-1426826cdc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5fb7f17d074b8ba9d5a10b2e2f9c71'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.707700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 829/1649] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:29 2022] DELETE /identity/v3/users/3c5fb7f17d074b8ba9d5a10b2e2f9c71 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:29.708577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b81437d270f4001a59b433e529146f4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.709283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b81437d270f4001a59b433e529146f4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.748056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b81437d270f4001a59b433e529146f4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.786235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b81437d270f4001a59b433e529146f4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.801496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b81437d270f4001a59b433e529146f4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:29.847639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 821/1650] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:29 2022] DELETE /identity/v3/users/9b81437d270f4001a59b433e529146f4 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:29.853915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2726-28b8-4f22-91e8-4c11441c1036 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:29.854856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2726-28b8-4f22-91e8-4c11441c1036 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:29.854856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2726-28b8-4f22-91e8-4c11441c1036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:29.903839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2b7e2726-28b8-4f22-91e8-4c11441c1036 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:29.910568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2b7e2726-28b8-4f22-91e8-4c11441c1036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:30.049834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:30.119170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 830/1651] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:40:30.142003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:30.143175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:30.255350 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e35252-ee14-4f6c-aff7-74d4758fb2a5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:30.260569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa311d-4f0d-4388-a40b-cf82b7f951d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:30.261242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa311d-4f0d-4388-a40b-cf82b7f951d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:30.261501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa311d-4f0d-4388-a40b-cf82b7f951d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:30.261776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa311d-4f0d-4388-a40b-cf82b7f951d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:30.277578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa311d-4f0d-4388-a40b-cf82b7f951d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:30.279849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa311d-4f0d-4388-a40b-cf82b7f951d6 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:30.298849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 822/1652] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:31.334061 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e2726-28b8-4f22-91e8-4c11441c1036 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:31.337175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2b7e2726-28b8-4f22-91e8-4c11441c1036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:31.360506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e2726-28b8-4f22-91e8-4c11441c1036 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:31.381119 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:31.382290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:31.382930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:31.383504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] PATH_INFO: `/v3/projects/49211a32815244cda14ce201f13041c6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:31.388090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49211a32815244cda14ce201f13041c6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:31.390434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:31.591666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49211a32815244cda14ce201f13041c6', 'request_id': 'req-e7fa0201-0871-46e2-b380-0934ea4fd4d3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:31.611779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49211a32815244cda14ce201f13041c6', 'request_id': 'req-e7fa0201-0871-46e2-b380-0934ea4fd4d3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:31.639523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49211a32815244cda14ce201f13041c6', 'request_id': 'req-e7fa0201-0871-46e2-b380-0934ea4fd4d3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:31.686289 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] The token cache is being invalidate because project 49211a32815244cda14ce201f13041c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:31.687043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:31.689450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7fa0201-0871-46e2-b380-0934ea4fd4d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:31.696811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 831/1653] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:31 2022] DELETE /identity/v3/projects/49211a32815244cda14ce201f13041c6 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:31.702039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318685dd-c2a5-46e0-8284-5d1a34a8f196 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:31.702490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318685dd-c2a5-46e0-8284-5d1a34a8f196 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:31.702639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318685dd-c2a5-46e0-8284-5d1a34a8f196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:31.805173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-318685dd-c2a5-46e0-8284-5d1a34a8f196 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:31.813912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-318685dd-c2a5-46e0-8284-5d1a34a8f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:31.996581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:32.029628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 823/1654] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:32.036357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190456bc-2b19-42a8-9e6b-4c0cf1ff0a4e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.036973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190456bc-2b19-42a8-9e6b-4c0cf1ff0a4e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.037180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190456bc-2b19-42a8-9e6b-4c0cf1ff0a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.105797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-190456bc-2b19-42a8-9e6b-4c0cf1ff0a4e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:32.112796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318685dd-c2a5-46e0-8284-5d1a34a8f196 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:32.114519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-318685dd-c2a5-46e0-8284-5d1a34a8f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:32.126400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-190456bc-2b19-42a8-9e6b-4c0cf1ff0a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:32.138294 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318685dd-c2a5-46e0-8284-5d1a34a8f196 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:32.146221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 832/1655] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:32.150036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190456bc-2b19-42a8-9e6b-4c0cf1ff0a4e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:32.150803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:32.153099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.155348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.155925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] PATH_INFO: `/v3/users/76791dc5fbdf4c61919308cd1eaf91fb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.158420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76791dc5fbdf4c61919308cd1eaf91fb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:32.162149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:32.175062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190456bc-2b19-42a8-9e6b-4c0cf1ff0a4e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:32.196993 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf36e20-06b0-4e4c-bb75-012ca7c00598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:32.198079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf36e20-06b0-4e4c-bb75-012ca7c00598 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.200560 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf36e20-06b0-4e4c-bb75-012ca7c00598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.201096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf36e20-06b0-4e4c-bb75-012ca7c00598 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.202020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf36e20-06b0-4e4c-bb75-012ca7c00598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:32.203445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf36e20-06b0-4e4c-bb75-012ca7c00598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:32.207812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf36e20-06b0-4e4c-bb75-012ca7c00598 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:32.240768 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 833/1656] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:32.247969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf36e20-06b0-4e4c-bb75-012ca7c00598 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:32.276843 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76791dc5fbdf4c61919308cd1eaf91fb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:32.280285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf36e20-06b0-4e4c-bb75-012ca7c00598 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:32.280845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76791dc5fbdf4c61919308cd1eaf91fb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:32.298135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea370288-935f-47c7-af2a-e4306d65183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:32.307095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea370288-935f-47c7-af2a-e4306d65183c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.308520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea370288-935f-47c7-af2a-e4306d65183c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.308799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea370288-935f-47c7-af2a-e4306d65183c admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.310469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea370288-935f-47c7-af2a-e4306d65183c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:32.312632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea370288-935f-47c7-af2a-e4306d65183c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:32.329951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76791dc5fbdf4c61919308cd1eaf91fb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:32.351879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76791dc5fbdf4c61919308cd1eaf91fb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:32.352768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2b62fd79-9bf1-4510-801a-86128e545c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76791dc5fbdf4c61919308cd1eaf91fb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:32.388768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 824/1657] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:32 2022] DELETE /identity/v3/users/76791dc5fbdf4c61919308cd1eaf91fb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:32.392047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67e1db-464c-417c-b13f-9aab694d81b9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.395724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67e1db-464c-417c-b13f-9aab694d81b9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.397635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 834/1658] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:32 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:32.398740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67e1db-464c-417c-b13f-9aab694d81b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.403275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea370288-935f-47c7-af2a-e4306d65183c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:32.411304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ea370288-935f-47c7-af2a-e4306d65183c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:32.457525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ca67e1db-464c-417c-b13f-9aab694d81b9 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:32.459694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ca67e1db-464c-417c-b13f-9aab694d81b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:32.559514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea370288-935f-47c7-af2a-e4306d65183c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:32.573866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e566f-01b5-4bf6-9555-ac6afecac485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:32.574964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e566f-01b5-4bf6-9555-ac6afecac485 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.575520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e566f-01b5-4bf6-9555-ac6afecac485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.575882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e566f-01b5-4bf6-9555-ac6afecac485 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.577860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e566f-01b5-4bf6-9555-ac6afecac485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:32.581040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e566f-01b5-4bf6-9555-ac6afecac485 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:32.599219 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 825/1659] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:32.617160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 835/1660] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:32 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:32.621178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67e1db-464c-417c-b13f-9aab694d81b9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:32.631899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67e1db-464c-417c-b13f-9aab694d81b9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:32.637230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676cd60-de8d-42cd-b2f1-aee0a629b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:32.638293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676cd60-de8d-42cd-b2f1-aee0a629b48a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.638786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676cd60-de8d-42cd-b2f1-aee0a629b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.639285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676cd60-de8d-42cd-b2f1-aee0a629b48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.640445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676cd60-de8d-42cd-b2f1-aee0a629b48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:32.642284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676cd60-de8d-42cd-b2f1-aee0a629b48a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:32.656541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 826/1661] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:32.661652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e566f-01b5-4bf6-9555-ac6afecac485 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:32.681738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e566f-01b5-4bf6-9555-ac6afecac485 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:32.691435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824793e-da52-4b7c-a044-71cde681bc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:32.693035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824793e-da52-4b7c-a044-71cde681bc14 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.694311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824793e-da52-4b7c-a044-71cde681bc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.695171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824793e-da52-4b7c-a044-71cde681bc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.696726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824793e-da52-4b7c-a044-71cde681bc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:32.699338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824793e-da52-4b7c-a044-71cde681bc14 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:32.707176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:32.748628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676cd60-de8d-42cd-b2f1-aee0a629b48a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:32.753099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1676cd60-de8d-42cd-b2f1-aee0a629b48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:32.754204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 836/1662] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:40:32.758562 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824793e-da52-4b7c-a044-71cde681bc14 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:32.774268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824793e-da52-4b7c-a044-71cde681bc14 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:32.791760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4314b-0fa9-4bbc-82b3-ebe46a463a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:32.797115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4314b-0fa9-4bbc-82b3-ebe46a463a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.797679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4314b-0fa9-4bbc-82b3-ebe46a463a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.798107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4314b-0fa9-4bbc-82b3-ebe46a463a28 admin admin] PATH_INFO: `/v3/projects/a208945911c04aa88ba52b31ec6e0890/users/6fe739698b7b4b69b9adbdc9e2c9e7c2/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.853552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4314b-0fa9-4bbc-82b3-ebe46a463a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a208945911c04aa88ba52b31ec6e0890, user_id=6fe739698b7b4b69b9adbdc9e2c9e7c2, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:32.857071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4314b-0fa9-4bbc-82b3-ebe46a463a28 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:32.923198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 837/1663] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:32 2022] PUT /identity/v3/projects/a208945911c04aa88ba52b31ec6e0890/users/6fe739698b7b4b69b9adbdc9e2c9e7c2/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:32.926232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676cd60-de8d-42cd-b2f1-aee0a629b48a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:32.951233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5918-4d67-4cec-a923-6fe1a7fbc88f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:32.951521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5918-4d67-4cec-a923-6fe1a7fbc88f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:32.952734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba5918-4d67-4cec-a923-6fe1a7fbc88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:32.955665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:33.024462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-32ba5918-4d67-4cec-a923-6fe1a7fbc88f None None] MFA Rules not processed for user `6fe739698b7b4b69b9adbdc9e2c9e7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:33.027148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-32ba5918-4d67-4cec-a923-6fe1a7fbc88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:33.103218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e16e6b-4574-4d8f-958e-b301a2c401ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:33.104990 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e16e6b-4574-4d8f-958e-b301a2c401ad service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:33.105279 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e16e6b-4574-4d8f-958e-b301a2c401ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:33.105559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e16e6b-4574-4d8f-958e-b301a2c401ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:33.205532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 838/1664] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:33.206687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba5918-4d67-4cec-a923-6fe1a7fbc88f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:33.209144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-32ba5918-4d67-4cec-a923-6fe1a7fbc88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:33.270493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e16e6b-4574-4d8f-958e-b301a2c401ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:33.274393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e16e6b-4574-4d8f-958e-b301a2c401ad service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:33.308311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 827/1665] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:33.309508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e16e6b-4574-4d8f-958e-b301a2c401ad service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:33.329421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba5918-4d67-4cec-a923-6fe1a7fbc88f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:33.336898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e16e6b-4574-4d8f-958e-b301a2c401ad service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:33.337146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:33.337146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:33.337146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:33.337788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] PATH_INFO: `/v3/users/caa013b096714c1f8053c6aeceb335d9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:33.338598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa013b096714c1f8053c6aeceb335d9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:33.340832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:33.350868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38432bf0-23b1-49f1-b514-6f819363caf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:33.352593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38432bf0-23b1-49f1-b514-6f819363caf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:33.352965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38432bf0-23b1-49f1-b514-6f819363caf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:33.353880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38432bf0-23b1-49f1-b514-6f819363caf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:33.354601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38432bf0-23b1-49f1-b514-6f819363caf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:33.360745 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38432bf0-23b1-49f1-b514-6f819363caf6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:33.420537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 828/1666] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:33 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:33.426378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38432bf0-23b1-49f1-b514-6f819363caf6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:33.440925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa013b096714c1f8053c6aeceb335d9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.441877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa013b096714c1f8053c6aeceb335d9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.479497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa013b096714c1f8053c6aeceb335d9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.483679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:33.499961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa013b096714c1f8053c6aeceb335d9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.526194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa013b096714c1f8053c6aeceb335d9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.544639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 839/1667] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:33 2022] DELETE /identity/v3/users/caa013b096714c1f8053c6aeceb335d9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:33.547306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:33.552805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:33.580300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38432bf0-23b1-49f1-b514-6f819363caf6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:33.691840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf3849-1a09-4791-98d8-6b7caa106a8f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:33.692723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:33.712322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:33.714697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:33.715323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:33.715779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] PATH_INFO: `/v3/projects/480dab9974de4df3a01cad7599cf5ef7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:33.718641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=480dab9974de4df3a01cad7599cf5ef7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:33.724679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:33.740218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2746151-faf8-4cc4-b7a6-ef944ddcbebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:33.742450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2746151-faf8-4cc4-b7a6-ef944ddcbebb admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:33.743499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2746151-faf8-4cc4-b7a6-ef944ddcbebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:33.744038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2746151-faf8-4cc4-b7a6-ef944ddcbebb admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:33.746223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2746151-faf8-4cc4-b7a6-ef944ddcbebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:33.752466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2746151-faf8-4cc4-b7a6-ef944ddcbebb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:33.796552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 829/1668] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:33 2022] POST /identity/v3/users => generated 294 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:33.799205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edf50-5793-405a-97ab-b06eeb56ec78 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:33.799777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edf50-5793-405a-97ab-b06eeb56ec78 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:33.800084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edf50-5793-405a-97ab-b06eeb56ec78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:33.831166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4d6edf50-5793-405a-97ab-b06eeb56ec78 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:33.833246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4d6edf50-5793-405a-97ab-b06eeb56ec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:33.834213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480dab9974de4df3a01cad7599cf5ef7', 'request_id': 'req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.860633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480dab9974de4df3a01cad7599cf5ef7', 'request_id': 'req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.878522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480dab9974de4df3a01cad7599cf5ef7', 'request_id': 'req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.901905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] The token cache is being invalidate because project 480dab9974de4df3a01cad7599cf5ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:33.902996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.905166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:33.907809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 840/1669] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:33 2022] DELETE /identity/v3/projects/480dab9974de4df3a01cad7599cf5ef7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:33.909043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:33.911026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:33.996513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49801c3-f1f1-4c59-9dc2-a03e6761bd4b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:34.002210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278cb6e-c991-441e-9378-ffa0aa7972eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:34.003232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278cb6e-c991-441e-9378-ffa0aa7972eb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.003714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278cb6e-c991-441e-9378-ffa0aa7972eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.004325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278cb6e-c991-441e-9378-ffa0aa7972eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.005915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278cb6e-c991-441e-9378-ffa0aa7972eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:34.008760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278cb6e-c991-441e-9378-ffa0aa7972eb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:34.008994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 830/1670] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:34.013746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4271b3-da73-409c-8dc6-f7980464508b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.014029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4271b3-da73-409c-8dc6-f7980464508b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.014375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4271b3-da73-409c-8dc6-f7980464508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.024489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 841/1671] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:34.028315 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278cb6e-c991-441e-9378-ffa0aa7972eb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:34.044443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278cb6e-c991-441e-9378-ffa0aa7972eb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:34.051942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d522c-5b7f-4726-8504-ad9080988394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:34.052821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d522c-5b7f-4726-8504-ad9080988394 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.053331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d522c-5b7f-4726-8504-ad9080988394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.053800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d522c-5b7f-4726-8504-ad9080988394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.054886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d522c-5b7f-4726-8504-ad9080988394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:34.059047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d522c-5b7f-4726-8504-ad9080988394 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:34.063781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:34.082969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0d4271b3-da73-409c-8dc6-f7980464508b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:34.084421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0d4271b3-da73-409c-8dc6-f7980464508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:34.088816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 842/1672] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:34.093966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d522c-5b7f-4726-8504-ad9080988394 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:34.105153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a11d522c-5b7f-4726-8504-ad9080988394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:34.122283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 831/1673] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:34.129400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4271b3-da73-409c-8dc6-f7980464508b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:34.154968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4271b3-da73-409c-8dc6-f7980464508b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:34.176645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b02af4-f934-431f-8549-09ea62ee87bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:34.177399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02af4-f934-431f-8549-09ea62ee87bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.177684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02af4-f934-431f-8549-09ea62ee87bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.177958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02af4-f934-431f-8549-09ea62ee87bc admin admin] PATH_INFO: `/v3/projects/02eb481375bf45e0ac5a909d402bca5b/users/3d617cfd40c0443980e1f39f5c67da3f/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.215844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b02af4-f934-431f-8549-09ea62ee87bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=02eb481375bf45e0ac5a909d402bca5b, user_id=3d617cfd40c0443980e1f39f5c67da3f, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:34.218728 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b02af4-f934-431f-8549-09ea62ee87bc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:34.264848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 832/1674] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:34 2022] PUT /identity/v3/projects/02eb481375bf45e0ac5a909d402bca5b/users/3d617cfd40c0443980e1f39f5c67da3f/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:34.270609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc9dd-e8b8-45cc-acbf-9491d2b45fc0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.271009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc9dd-e8b8-45cc-acbf-9491d2b45fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.271333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc9dd-e8b8-45cc-acbf-9491d2b45fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.281543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d522c-5b7f-4726-8504-ad9080988394 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:34.340209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c03cc9dd-e8b8-45cc-acbf-9491d2b45fc0 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:34.343550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c03cc9dd-e8b8-45cc-acbf-9491d2b45fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:34.466819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41133b4-57b6-406f-af3a-1d312097b93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:34.467536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41133b4-57b6-406f-af3a-1d312097b93e service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.467761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41133b4-57b6-406f-af3a-1d312097b93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.468035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41133b4-57b6-406f-af3a-1d312097b93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.537530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 833/1675] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:34.539671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71452c-1bd6-4077-87f0-c6b1a110d33e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.539940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71452c-1bd6-4077-87f0-c6b1a110d33e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.540217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71452c-1bd6-4077-87f0-c6b1a110d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.618121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bb71452c-1bd6-4077-87f0-c6b1a110d33e None None] MFA Rules not processed for user `3d617cfd40c0443980e1f39f5c67da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:34.619393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bb71452c-1bd6-4077-87f0-c6b1a110d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:34.641621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41133b4-57b6-406f-af3a-1d312097b93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:34.643536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41133b4-57b6-406f-af3a-1d312097b93e service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:34.662180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 843/1676] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:34.663360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41133b4-57b6-406f-af3a-1d312097b93e service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:34.708082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:34.744037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41133b4-57b6-406f-af3a-1d312097b93e service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:34.777976 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 834/1677] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:34.779059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71452c-1bd6-4077-87f0-c6b1a110d33e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:34.797754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34b3db-11ad-4d84-b1fd-0a5e5b80bcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:34.801337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b3db-11ad-4d84-b1fd-0a5e5b80bcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.801926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b3db-11ad-4d84-b1fd-0a5e5b80bcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.803059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b3db-11ad-4d84-b1fd-0a5e5b80bcd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.804024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34b3db-11ad-4d84-b1fd-0a5e5b80bcd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:34.807023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34b3db-11ad-4d84-b1fd-0a5e5b80bcd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:34.807190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71452c-1bd6-4077-87f0-c6b1a110d33e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:34.809233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34b3db-11ad-4d84-b1fd-0a5e5b80bcd2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:34.817201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6e5f-c3e6-4613-bd20-dfee44683704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:34.817752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6e5f-c3e6-4613-bd20-dfee44683704 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.818030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6e5f-c3e6-4613-bd20-dfee44683704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.818305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6e5f-c3e6-4613-bd20-dfee44683704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.819013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6e5f-c3e6-4613-bd20-dfee44683704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:34.821101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6e5f-c3e6-4613-bd20-dfee44683704 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:34.843341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 844/1678] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:34.845036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a627e-3f84-4ae1-90d7-2eb3272b7a15 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:34.845447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a627e-3f84-4ae1-90d7-2eb3272b7a15 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:34.845825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a627e-3f84-4ae1-90d7-2eb3272b7a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:34.885946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6d5a627e-3f84-4ae1-90d7-2eb3272b7a15 None None] MFA Rules not processed for user `d6a6f20d09bc4d5abc7c2a7fc02376b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:34.888155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6d5a627e-3f84-4ae1-90d7-2eb3272b7a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:34.903092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 835/1679] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:34 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:34.906785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6e5f-c3e6-4613-bd20-dfee44683704 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:35.032991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:35.052745 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6e5f-c3e6-4613-bd20-dfee44683704 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:35.065037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea63b2-aeb0-4423-9b3a-0b6e4ddeaee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:35.065700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea63b2-aeb0-4423-9b3a-0b6e4ddeaee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:35.065981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea63b2-aeb0-4423-9b3a-0b6e4ddeaee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:35.066252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea63b2-aeb0-4423-9b3a-0b6e4ddeaee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:35.066940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea63b2-aeb0-4423-9b3a-0b6e4ddeaee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:35.069027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea63b2-aeb0-4423-9b3a-0b6e4ddeaee3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:35.127556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 836/1680] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:34 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:35.131393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea63b2-aeb0-4423-9b3a-0b6e4ddeaee3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:35.146014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 845/1681] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:35.148506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a627e-3f84-4ae1-90d7-2eb3272b7a15 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:35.176014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a627e-3f84-4ae1-90d7-2eb3272b7a15 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:35.338437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea63b2-aeb0-4423-9b3a-0b6e4ddeaee3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:35.354478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbf405-ef0f-42d7-b28f-43a47dcdaa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:35.356805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbf405-ef0f-42d7-b28f-43a47dcdaa15 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:35.356928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d3dc-e9e9-4ca3-bf47-d72553d14123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:35.357055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbf405-ef0f-42d7-b28f-43a47dcdaa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:35.357055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbf405-ef0f-42d7-b28f-43a47dcdaa15 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:35.357209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d3dc-e9e9-4ca3-bf47-d72553d14123 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:35.357290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d3dc-e9e9-4ca3-bf47-d72553d14123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:35.357509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d3dc-e9e9-4ca3-bf47-d72553d14123 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:35.358197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062d3dc-e9e9-4ca3-bf47-d72553d14123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:35.362951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbf405-ef0f-42d7-b28f-43a47dcdaa15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:35.367613 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbf405-ef0f-42d7-b28f-43a47dcdaa15 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:35.372176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062d3dc-e9e9-4ca3-bf47-d72553d14123 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:35.424699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 846/1682] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:35 2022] POST /identity/v3/users => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:35.428283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbf405-ef0f-42d7-b28f-43a47dcdaa15 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:35.432875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eedbf405-ef0f-42d7-b28f-43a47dcdaa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:35.439448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 837/1683] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:35 2022] POST /identity/v3/users => generated 300 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:35.440411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d3dc-e9e9-4ca3-bf47-d72553d14123 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:35.468774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d3dc-e9e9-4ca3-bf47-d72553d14123 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:35.480427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f70d70-d02a-4b4c-bba4-7a6af6583ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:35.481298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f70d70-d02a-4b4c-bba4-7a6af6583ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:35.481724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f70d70-d02a-4b4c-bba4-7a6af6583ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:35.482135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f70d70-d02a-4b4c-bba4-7a6af6583ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:35.485438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f70d70-d02a-4b4c-bba4-7a6af6583ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:35.494328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f70d70-d02a-4b4c-bba4-7a6af6583ab6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:35.516673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 838/1684] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:35.516673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f70d70-d02a-4b4c-bba4-7a6af6583ab6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:35.570942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f70d70-d02a-4b4c-bba4-7a6af6583ab6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:35.578106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016be29-bc9d-4669-a8cf-8a500bba1351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:35.580101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016be29-bc9d-4669-a8cf-8a500bba1351 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:35.580397 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016be29-bc9d-4669-a8cf-8a500bba1351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:35.580669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016be29-bc9d-4669-a8cf-8a500bba1351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:35.583203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016be29-bc9d-4669-a8cf-8a500bba1351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:35.602746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016be29-bc9d-4669-a8cf-8a500bba1351 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:35.637496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 839/1685] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:35.655238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016be29-bc9d-4669-a8cf-8a500bba1351 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:35.693765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbf405-ef0f-42d7-b28f-43a47dcdaa15 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:35.702707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016be29-bc9d-4669-a8cf-8a500bba1351 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:35.709403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a70bc-2723-4dc9-b2ae-28a9ef1938df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:35.710044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a70bc-2723-4dc9-b2ae-28a9ef1938df service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:35.710361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a70bc-2723-4dc9-b2ae-28a9ef1938df service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:35.710628 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a70bc-2723-4dc9-b2ae-28a9ef1938df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:35.725722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdbec5-b3b9-4ad8-9332-c1459b040eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:35.726561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdbec5-b3b9-4ad8-9332-c1459b040eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:35.727116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdbec5-b3b9-4ad8-9332-c1459b040eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:35.727536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdbec5-b3b9-4ad8-9332-c1459b040eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:35.728385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdbec5-b3b9-4ad8-9332-c1459b040eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:35.730184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdbec5-b3b9-4ad8-9332-c1459b040eeb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:35.739586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:35.765605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 840/1686] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:35.766820 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdbec5-b3b9-4ad8-9332-c1459b040eeb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:35.769625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f3bdbec5-b3b9-4ad8-9332-c1459b040eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:35.789944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdbec5-b3b9-4ad8-9332-c1459b040eeb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:35.805050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:35.808036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:35.808797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:35.809336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] PATH_INFO: `/v3/projects/8e3b8b3604174dba9436582a15895f28` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:35.810809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3b8b3604174dba9436582a15895f28)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:35.818203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:35.888851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a70bc-2723-4dc9-b2ae-28a9ef1938df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:35.890760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a70bc-2723-4dc9-b2ae-28a9ef1938df service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:35.924223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 847/1687] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:35.926102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a70bc-2723-4dc9-b2ae-28a9ef1938df service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:36.003957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a70bc-2723-4dc9-b2ae-28a9ef1938df service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:36.025638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:36.035024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3b8b3604174dba9436582a15895f28', 'request_id': 'req-b44160ba-f3b7-4a01-a9ce-461d079306c4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.058226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3b8b3604174dba9436582a15895f28', 'request_id': 'req-b44160ba-f3b7-4a01-a9ce-461d079306c4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.076018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3b8b3604174dba9436582a15895f28', 'request_id': 'req-b44160ba-f3b7-4a01-a9ce-461d079306c4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.124092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] The token cache is being invalidate because project 8e3b8b3604174dba9436582a15895f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:36.124559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.126439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.130381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 841/1688] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:35 2022] DELETE /identity/v3/projects/8e3b8b3604174dba9436582a15895f28 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:36.131481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:36.134873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:36.172123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edee53-b248-4c28-b1b3-695c50f55aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:36.172976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edee53-b248-4c28-b1b3-695c50f55aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:36.173258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edee53-b248-4c28-b1b3-695c50f55aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:36.173532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edee53-b248-4c28-b1b3-695c50f55aa3 admin admin] PATH_INFO: `/v3/projects/31e05e566c0a46c1a590b198fab93e06/users/1cd5b9c9adef4c9d82b7d95bd2a96873/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:36.223605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edee53-b248-4c28-b1b3-695c50f55aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e05e566c0a46c1a590b198fab93e06, user_id=1cd5b9c9adef4c9d82b7d95bd2a96873, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:36.228864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edee53-b248-4c28-b1b3-695c50f55aa3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:36.256550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 848/1689] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:35 2022] PUT /identity/v3/projects/31e05e566c0a46c1a590b198fab93e06/users/1cd5b9c9adef4c9d82b7d95bd2a96873/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:36.257624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edee53-b248-4c28-b1b3-695c50f55aa3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:36.259570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-73edee53-b248-4c28-b1b3-695c50f55aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:36.329977 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44160ba-f3b7-4a01-a9ce-461d079306c4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:36.390966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edee53-b248-4c28-b1b3-695c50f55aa3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:36.407594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:36.409893 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:36.410337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:36.411835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] PATH_INFO: `/v3/projects/c4c1980482ac408fb5c52e41d0819409` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:36.416598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c1980482ac408fb5c52e41d0819409)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:36.420619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:36.505792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09551b2a-a628-4891-ae4d-c87d4b6a9ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:36.506966 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09551b2a-a628-4891-ae4d-c87d4b6a9ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:36.508249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09551b2a-a628-4891-ae4d-c87d4b6a9ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:36.508655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09551b2a-a628-4891-ae4d-c87d4b6a9ad7 admin admin] PATH_INFO: `/v3/projects/7d2fd8f42e48435fbeff8f863d34b47f/users/595cf62f66f3484688771031da5dd7dd/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:36.545998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09551b2a-a628-4891-ae4d-c87d4b6a9ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2fd8f42e48435fbeff8f863d34b47f, user_id=595cf62f66f3484688771031da5dd7dd, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:36.553880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09551b2a-a628-4891-ae4d-c87d4b6a9ad7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:36.568373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c1980482ac408fb5c52e41d0819409', 'request_id': 'req-763fdd2e-1a2a-4286-8664-5961e05a1be6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.575577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 842/1690] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:36 2022] PUT /identity/v3/projects/7d2fd8f42e48435fbeff8f863d34b47f/users/595cf62f66f3484688771031da5dd7dd/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:36.577301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482f58-11b4-4cd3-8251-a03411b22937 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:36.578041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482f58-11b4-4cd3-8251-a03411b22937 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:36.578537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482f58-11b4-4cd3-8251-a03411b22937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:36.599157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c1980482ac408fb5c52e41d0819409', 'request_id': 'req-763fdd2e-1a2a-4286-8664-5961e05a1be6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.612917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c1980482ac408fb5c52e41d0819409', 'request_id': 'req-763fdd2e-1a2a-4286-8664-5961e05a1be6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.628005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-30482f58-11b4-4cd3-8251-a03411b22937 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:36.629483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-30482f58-11b4-4cd3-8251-a03411b22937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:36.647418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] The token cache is being invalidate because project c4c1980482ac408fb5c52e41d0819409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:36.647418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.648529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:36.650477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:36.651744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 849/1691] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:36 2022] DELETE /identity/v3/projects/c4c1980482ac408fb5c52e41d0819409 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:36.652399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:36.657147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:36.713392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:36.796398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 843/1692] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:36.797384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da378227-8ad1-48b3-b9de-091ca2dd4b68 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:36.797746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da378227-8ad1-48b3-b9de-091ca2dd4b68 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:36.798092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da378227-8ad1-48b3-b9de-091ca2dd4b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:36.872488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fdd2e-1a2a-4286-8664-5961e05a1be6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:36.897581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-da378227-8ad1-48b3-b9de-091ca2dd4b68 None None] MFA Rules not processed for user `595cf62f66f3484688771031da5dd7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:36.900463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-da378227-8ad1-48b3-b9de-091ca2dd4b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:36.900605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df504b-3ca6-4db6-b3bb-05a5d4ad84e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:36.901206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df504b-3ca6-4db6-b3bb-05a5d4ad84e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:36.901493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df504b-3ca6-4db6-b3bb-05a5d4ad84e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:36.908609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df504b-3ca6-4db6-b3bb-05a5d4ad84e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:36.909243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df504b-3ca6-4db6-b3bb-05a5d4ad84e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:36.914838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df504b-3ca6-4db6-b3bb-05a5d4ad84e1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:36.955628 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 850/1693] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:36.963226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df504b-3ca6-4db6-b3bb-05a5d4ad84e1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:36.972882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d9df504b-3ca6-4db6-b3bb-05a5d4ad84e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:37.004133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df504b-3ca6-4db6-b3bb-05a5d4ad84e1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:37.020334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:37.021220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:37.021846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:37.024494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] PATH_INFO: `/v3/users/cd80e3c6826b400f8676a86047ba3d86` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:37.027009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd80e3c6826b400f8676a86047ba3d86)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:37.029115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:37.123498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 844/1694] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:36 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:37.125536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9f1b-b795-4098-820f-29e9e5e600d4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:37.125921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9f1b-b795-4098-820f-29e9e5e600d4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:37.126858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9f1b-b795-4098-820f-29e9e5e600d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:37.153301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-11be9f1b-b795-4098-820f-29e9e5e600d4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:37.157454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-11be9f1b-b795-4098-820f-29e9e5e600d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:37.177019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd80e3c6826b400f8676a86047ba3d86'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:37.179433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd80e3c6826b400f8676a86047ba3d86'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:37.193250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 845/1695] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:37.196960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b05e2-5b02-430c-98fb-aeb0aa931407 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:37.198563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b05e2-5b02-430c-98fb-aeb0aa931407 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:37.199748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b05e2-5b02-430c-98fb-aeb0aa931407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:37.223736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd80e3c6826b400f8676a86047ba3d86'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:37.239430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd80e3c6826b400f8676a86047ba3d86'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:37.273619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd80e3c6826b400f8676a86047ba3d86'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:37.309449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 851/1696] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:36 2022] DELETE /identity/v3/users/cd80e3c6826b400f8676a86047ba3d86 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:37.313822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:37.316502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-239b05e2-5b02-430c-98fb-aeb0aa931407 None None] MFA Rules not processed for user `41e527395daf428ab00fd78c2412ed13`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:37.319126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:37.320476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-239b05e2-5b02-430c-98fb-aeb0aa931407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:37.512352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94992b1-6333-4356-a0d9-0b8c9f0cbfb5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:37.518791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 846/1697] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:37.531374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b05e2-5b02-430c-98fb-aeb0aa931407 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:37.536219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3c07-fbaf-4e52-bcb0-bc031731fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:37.537016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-239b05e2-5b02-430c-98fb-aeb0aa931407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:37.537679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3c07-fbaf-4e52-bcb0-bc031731fdad admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:37.537964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3c07-fbaf-4e52-bcb0-bc031731fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:37.540476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3c07-fbaf-4e52-bcb0-bc031731fdad admin admin] PATH_INFO: `/v3/projects/31e05e566c0a46c1a590b198fab93e06/users/1cd5b9c9adef4c9d82b7d95bd2a96873/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:37.545213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c3c07-fbaf-4e52-bcb0-bc031731fdad admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e05e566c0a46c1a590b198fab93e06, user_id=1cd5b9c9adef4c9d82b7d95bd2a96873, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:37.556377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c3c07-fbaf-4e52-bcb0-bc031731fdad admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:37.572705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b05e2-5b02-430c-98fb-aeb0aa931407 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:37.602942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 852/1698] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:37 2022] PUT /identity/v3/projects/31e05e566c0a46c1a590b198fab93e06/users/1cd5b9c9adef4c9d82b7d95bd2a96873/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:37.604063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3c07-fbaf-4e52-bcb0-bc031731fdad admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:37.605743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:37.614332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1c0c3c07-fbaf-4e52-bcb0-bc031731fdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:37.664664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:37.711557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb2e8e-f452-4a32-8178-020d4218c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:37.712748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb2e8e-f452-4a32-8178-020d4218c810 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:37.713601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb2e8e-f452-4a32-8178-020d4218c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:37.713601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb2e8e-f452-4a32-8178-020d4218c810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:37.714509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb2e8e-f452-4a32-8178-020d4218c810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:37.717305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb2e8e-f452-4a32-8178-020d4218c810 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:37.774554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3c07-fbaf-4e52-bcb0-bc031731fdad admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:37.793652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489e727-98bd-4399-bbd9-6e8cfa7e1cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:37.794842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e727-98bd-4399-bbd9-6e8cfa7e1cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:37.794842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e727-98bd-4399-bbd9-6e8cfa7e1cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:37.794842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e727-98bd-4399-bbd9-6e8cfa7e1cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:37.795694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e727-98bd-4399-bbd9-6e8cfa7e1cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:37.795878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e727-98bd-4399-bbd9-6e8cfa7e1cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:37.797819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 847/1699] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:37 2022] POST /identity/v3/projects => generated 405 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:37.799339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c43b-7f60-4e12-b800-87402396515f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:37.801107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e727-98bd-4399-bbd9-6e8cfa7e1cc8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:37.810531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c43b-7f60-4e12-b800-87402396515f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:37.816068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c43b-7f60-4e12-b800-87402396515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:37.829400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 853/1700] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:37.831260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a1fed-6b78-444c-9d12-5332755c70e6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:37.831554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a1fed-6b78-444c-9d12-5332755c70e6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:37.831829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a1fed-6b78-444c-9d12-5332755c70e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:37.883407 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6877c43b-7f60-4e12-b800-87402396515f None None] MFA Rules not processed for user `41e527395daf428ab00fd78c2412ed13`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:37.885477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6877c43b-7f60-4e12-b800-87402396515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:37.903462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9e5a1fed-6b78-444c-9d12-5332755c70e6 None None] MFA Rules not processed for user `1cd5b9c9adef4c9d82b7d95bd2a96873`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:37.903901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9e5a1fed-6b78-444c-9d12-5332755c70e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:38.098939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 848/1701] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:38.106688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 854/1702] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:38.108195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877c43b-7f60-4e12-b800-87402396515f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:38.110707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a1fed-6b78-444c-9d12-5332755c70e6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:38.244344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877c43b-7f60-4e12-b800-87402396515f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:38.249878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c1f3-035c-4e7d-b751-33aeccae1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:38.250530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c1f3-035c-4e7d-b751-33aeccae1494 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:38.250811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c1f3-035c-4e7d-b751-33aeccae1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:38.251300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c1f3-035c-4e7d-b751-33aeccae1494 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:38.252137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2c1f3-035c-4e7d-b751-33aeccae1494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:38.254093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2c1f3-035c-4e7d-b751-33aeccae1494 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:38.294292 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 849/1703] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:38 2022] POST /identity/v3/users => generated 309 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:38.295267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c1f3-035c-4e7d-b751-33aeccae1494 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:38.302385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7ae2c1f3-035c-4e7d-b751-33aeccae1494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:38.305181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a1fed-6b78-444c-9d12-5332755c70e6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:38.322221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5e926-75c5-4937-92cb-c74c619e98c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:38.323196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5e926-75c5-4937-92cb-c74c619e98c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:38.323480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5e926-75c5-4937-92cb-c74c619e98c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:38.323868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5e926-75c5-4937-92cb-c74c619e98c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:38.324440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5e926-75c5-4937-92cb-c74c619e98c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:38.336627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5e926-75c5-4937-92cb-c74c619e98c6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:38.444092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 855/1704] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:38 2022] POST /identity/v3/projects => generated 365 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:38.444092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5e926-75c5-4937-92cb-c74c619e98c6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:38.449920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-18b5e926-75c5-4937-92cb-c74c619e98c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:38.476830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:38.551336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:38.572970 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c1f3-035c-4e7d-b751-33aeccae1494 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:38.613716 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5e926-75c5-4937-92cb-c74c619e98c6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:38.620240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c27d-b136-4dc9-bb8b-33b850e3aa14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:38.621746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c27d-b136-4dc9-bb8b-33b850e3aa14 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:38.623664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c27d-b136-4dc9-bb8b-33b850e3aa14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:38.624104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c27d-b136-4dc9-bb8b-33b850e3aa14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:38.784935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3bb89-788c-4c1e-b776-f96f87b16319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:38.785672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3bb89-788c-4c1e-b776-f96f87b16319 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:38.785960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3bb89-788c-4c1e-b776-f96f87b16319 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:38.786238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3bb89-788c-4c1e-b776-f96f87b16319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:38.840923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528c27d-b136-4dc9-bb8b-33b850e3aa14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:38.845340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528c27d-b136-4dc9-bb8b-33b850e3aa14 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:38.874401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 856/1705] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:38.882379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c27d-b136-4dc9-bb8b-33b850e3aa14 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:38.959260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3bb89-788c-4c1e-b776-f96f87b16319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:38.961113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3bb89-788c-4c1e-b776-f96f87b16319 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:39.003032 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 850/1706] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:39.003032 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3bb89-788c-4c1e-b776-f96f87b16319 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:39.084175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c27d-b136-4dc9-bb8b-33b850e3aa14 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:39.099819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d9d57-759c-4f84-9849-532ca8dea9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:39.100482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d9d57-759c-4f84-9849-532ca8dea9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:39.101290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d9d57-759c-4f84-9849-532ca8dea9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:39.101567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d9d57-759c-4f84-9849-532ca8dea9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:39.102296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d9d57-759c-4f84-9849-532ca8dea9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:39.104006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d9d57-759c-4f84-9849-532ca8dea9e9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:39.147068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 857/1707] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:39.148665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33a31d-a48f-4318-b7e7-87a37c9b25a5 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:39.148979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33a31d-a48f-4318-b7e7-87a37c9b25a5 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:39.149261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33a31d-a48f-4318-b7e7-87a37c9b25a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:39.223357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3bb89-788c-4c1e-b776-f96f87b16319 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:39.240382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9a33a31d-a48f-4318-b7e7-87a37c9b25a5 None None] MFA Rules not processed for user `0a1e2409e3df40668c2ddbb6800ab7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:39.241685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9a33a31d-a48f-4318-b7e7-87a37c9b25a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:39.246140 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5871de-d6c2-4c7d-a626-75cebc0e7393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:39.253294 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5871de-d6c2-4c7d-a626-75cebc0e7393 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:39.253294 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5871de-d6c2-4c7d-a626-75cebc0e7393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:39.253294 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5871de-d6c2-4c7d-a626-75cebc0e7393 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:39.255816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5871de-d6c2-4c7d-a626-75cebc0e7393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:39.264686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5871de-d6c2-4c7d-a626-75cebc0e7393 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:39.339512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 851/1708] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:38 2022] POST /identity/v3/users => generated 283 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:39.340410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5871de-d6c2-4c7d-a626-75cebc0e7393 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:39.377452 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5871de-d6c2-4c7d-a626-75cebc0e7393 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:39.394323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95178c4-1365-4b52-ab3e-042ea1ed40db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:39.394537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95178c4-1365-4b52-ab3e-042ea1ed40db admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:39.394817 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95178c4-1365-4b52-ab3e-042ea1ed40db admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:39.395132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95178c4-1365-4b52-ab3e-042ea1ed40db admin admin] PATH_INFO: `/v3/projects/481a86da85a7404f8bb5bbf8f256e033/users/e5b78a4d837e486fb52335afaf194eb0/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:39.408929 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:39.438085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 858/1709] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:39.447901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33a31d-a48f-4318-b7e7-87a37c9b25a5 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:39.448007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95178c4-1365-4b52-ab3e-042ea1ed40db admin admin] RBAC: Authorizing `identity:create_grant(project_id=481a86da85a7404f8bb5bbf8f256e033, user_id=e5b78a4d837e486fb52335afaf194eb0, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:39.448007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95178c4-1365-4b52-ab3e-042ea1ed40db admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:39.455121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:39.468941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33a31d-a48f-4318-b7e7-87a37c9b25a5 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:39.473499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 852/1710] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:39 2022] PUT /identity/v3/projects/481a86da85a7404f8bb5bbf8f256e033/users/e5b78a4d837e486fb52335afaf194eb0/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:39.473499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89678d-9a09-4a54-aff5-d0331e9cc220 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:39.473739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89678d-9a09-4a54-aff5-d0331e9cc220 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:39.474101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89678d-9a09-4a54-aff5-d0331e9cc220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:39.525369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7d89678d-9a09-4a54-aff5-d0331e9cc220 None None] MFA Rules not processed for user `0a1e2409e3df40668c2ddbb6800ab7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:39.527936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7d89678d-9a09-4a54-aff5-d0331e9cc220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:39.666654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14fdbd-5af7-45ec-af79-3198274b3061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:39.668221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14fdbd-5af7-45ec-af79-3198274b3061 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:39.675752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14fdbd-5af7-45ec-af79-3198274b3061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:39.676626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14fdbd-5af7-45ec-af79-3198274b3061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:39.679774 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14fdbd-5af7-45ec-af79-3198274b3061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:39.688269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14fdbd-5af7-45ec-af79-3198274b3061 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:39.715233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 853/1711] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:39.716330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89678d-9a09-4a54-aff5-d0331e9cc220 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:39.728777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 859/1712] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:39.730328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14fdbd-5af7-45ec-af79-3198274b3061 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:39.741019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ee14fdbd-5af7-45ec-af79-3198274b3061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:39.745825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89678d-9a09-4a54-aff5-d0331e9cc220 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:39.764970 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c301d4-67e5-4e19-a230-9e8be7263735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:39.765431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c301d4-67e5-4e19-a230-9e8be7263735 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:39.765762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c301d4-67e5-4e19-a230-9e8be7263735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:39.766078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c301d4-67e5-4e19-a230-9e8be7263735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:39.766858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c301d4-67e5-4e19-a230-9e8be7263735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:39.768772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c301d4-67e5-4e19-a230-9e8be7263735 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:39.801513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 854/1713] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:39.802640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c301d4-67e5-4e19-a230-9e8be7263735 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:39.805559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14fdbd-5af7-45ec-af79-3198274b3061 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:39.818590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a7c301d4-67e5-4e19-a230-9e8be7263735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:39.823274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:39.824235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:39.824664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:39.825109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] PATH_INFO: `/v3/projects/3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:39.826868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:39.829376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:39.978340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3', 'request_id': 'req-f5596a47-484e-414f-9dfe-9798585b7978'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:39.995675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3', 'request_id': 'req-f5596a47-484e-414f-9dfe-9798585b7978'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:40.015491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3', 'request_id': 'req-f5596a47-484e-414f-9dfe-9798585b7978'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:40.050619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] The token cache is being invalidate because project 3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:40.051813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:40.054917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:40.059103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 860/1714] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:39 2022] DELETE /identity/v3/projects/3bd5bfe9e1af4d7a8f9cb8e0bbc6d4e3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:40.059785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:40.063512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c301d4-67e5-4e19-a230-9e8be7263735 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:40.065051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:40.234701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596a47-484e-414f-9dfe-9798585b7978 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:40.245160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc5db1-a90b-416f-b588-d6e22f9bb683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:40.246838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5db1-a90b-416f-b588-d6e22f9bb683 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:40.247747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5db1-a90b-416f-b588-d6e22f9bb683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:40.258465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee05d4-028a-44d6-927f-cd8aafeb87a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:40.259455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee05d4-028a-44d6-927f-cd8aafeb87a8 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:40.259747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee05d4-028a-44d6-927f-cd8aafeb87a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:40.260027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee05d4-028a-44d6-927f-cd8aafeb87a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:40.261988 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-54ee05d4-028a-44d6-927f-cd8aafeb87a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:40.288067 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc5db1-a90b-416f-b588-d6e22f9bb683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:40.288529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc5db1-a90b-416f-b588-d6e22f9bb683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:40.297006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc5db1-a90b-416f-b588-d6e22f9bb683 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:40.302672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:40.337285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 861/1715] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:40.338332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc5db1-a90b-416f-b588-d6e22f9bb683 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:40.345112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-75bc5db1-a90b-416f-b588-d6e22f9bb683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:40.403603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc5db1-a90b-416f-b588-d6e22f9bb683 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:40.431113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64518c3-4a09-4445-8137-c5b387ab4c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:40.431744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64518c3-4a09-4445-8137-c5b387ab4c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:40.432025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64518c3-4a09-4445-8137-c5b387ab4c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:40.432297 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64518c3-4a09-4445-8137-c5b387ab4c21 admin admin] PATH_INFO: `/v3/projects/481a86da85a7404f8bb5bbf8f256e033/users/e5b78a4d837e486fb52335afaf194eb0/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:40.438080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64518c3-4a09-4445-8137-c5b387ab4c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481a86da85a7404f8bb5bbf8f256e033, user_id=e5b78a4d837e486fb52335afaf194eb0, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:40.440819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64518c3-4a09-4445-8137-c5b387ab4c21 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:40.459458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee05d4-028a-44d6-927f-cd8aafeb87a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:40.463658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee05d4-028a-44d6-927f-cd8aafeb87a8 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:40.488565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 855/1716] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:40.491923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b895-7f4d-45ec-9ba7-adfce4bfde9d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:40.492431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b895-7f4d-45ec-9ba7-adfce4bfde9d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:40.492947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b895-7f4d-45ec-9ba7-adfce4bfde9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:40.503673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 862/1717] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:40 2022] PUT /identity/v3/projects/481a86da85a7404f8bb5bbf8f256e033/users/e5b78a4d837e486fb52335afaf194eb0/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:40.503673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64518c3-4a09-4445-8137-c5b387ab4c21 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:40.508498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a64518c3-4a09-4445-8137-c5b387ab4c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:40.530909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:40.565209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bc82b895-7f4d-45ec-9ba7-adfce4bfde9d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:40.633813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bc82b895-7f4d-45ec-9ba7-adfce4bfde9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:40.728075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64518c3-4a09-4445-8137-c5b387ab4c21 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:40.745085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd3821-d776-43c1-bae4-5e26b600728f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:40.745283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd3821-d776-43c1-bae4-5e26b600728f service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:40.745555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd3821-d776-43c1-bae4-5e26b600728f service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:40.745731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd3821-d776-43c1-bae4-5e26b600728f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:40.756189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b6dd3821-d776-43c1-bae4-5e26b600728f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:40.939333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 856/1718] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:40.940271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82b895-7f4d-45ec-9ba7-adfce4bfde9d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:40.960661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82b895-7f4d-45ec-9ba7-adfce4bfde9d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:40.966783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362191d-405a-48e0-8168-f9447209056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:40.967547 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362191d-405a-48e0-8168-f9447209056c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:40.967832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362191d-405a-48e0-8168-f9447209056c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:40.968242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362191d-405a-48e0-8168-f9447209056c admin admin] PATH_INFO: `/v3/projects/adef2ef17f154ac6a2bfa87840e1f6aa/users/e7a5c93920e042188f275d365880f8de/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:41.009898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362191d-405a-48e0-8168-f9447209056c admin admin] RBAC: Authorizing `identity:create_grant(project_id=adef2ef17f154ac6a2bfa87840e1f6aa, user_id=e7a5c93920e042188f275d365880f8de, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:41.012933 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362191d-405a-48e0-8168-f9447209056c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:41.023267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd3821-d776-43c1-bae4-5e26b600728f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:41.024891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd3821-d776-43c1-bae4-5e26b600728f service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:41.055121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 857/1719] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:40 2022] PUT /identity/v3/projects/adef2ef17f154ac6a2bfa87840e1f6aa/users/e7a5c93920e042188f275d365880f8de/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:41.055121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c75ac-75e2-41b5-b2e8-7315e459f8b5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:41.055121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c75ac-75e2-41b5-b2e8-7315e459f8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:41.055121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c75ac-75e2-41b5-b2e8-7315e459f8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:41.064815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 863/1720] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:41.065942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3f06-021b-417c-95c1-da7298c70393 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:41.066231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3f06-021b-417c-95c1-da7298c70393 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:41.069210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3f06-021b-417c-95c1-da7298c70393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:41.137141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-889f3f06-021b-417c-95c1-da7298c70393 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:41.143310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-889f3f06-021b-417c-95c1-da7298c70393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:41.159730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a41c75ac-75e2-41b5-b2e8-7315e459f8b5 None None] MFA Rules not processed for user `e5b78a4d837e486fb52335afaf194eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:41.163868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a41c75ac-75e2-41b5-b2e8-7315e459f8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:41.367594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 864/1721] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:41.372735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e16bc-b1dd-4a0b-b3a0-1bc1b7674487 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:41.372964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e16bc-b1dd-4a0b-b3a0-1bc1b7674487 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:41.373234 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e16bc-b1dd-4a0b-b3a0-1bc1b7674487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:41.393733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 858/1722] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:41 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:41.397904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6a84-cdfa-4d09-bf37-869386868cd9 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:41.398244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6a84-cdfa-4d09-bf37-869386868cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:41.398531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6a84-cdfa-4d09-bf37-869386868cd9 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:41.415365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 859/1723] 10.222.0.57 () {54 vars in 912 bytes} [Thu Aug 4 04:40:41 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:40:41.420369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6a84-cdfa-4d09-bf37-869386868cd9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:41.460874 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6a84-cdfa-4d09-bf37-869386868cd9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:41.495905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:41.504009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:41.505750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:41.506141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:41.508162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:41.508731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:41.510597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:41.521241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-504e16bc-b1dd-4a0b-b3a0-1bc1b7674487 None None] MFA Rules not processed for user `e7a5c93920e042188f275d365880f8de`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:41.526740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-504e16bc-b1dd-4a0b-b3a0-1bc1b7674487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:41.563846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 860/1724] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:40:41.569833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:41.580844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:41.605917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:41.701980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:41.774391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 865/1725] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:41.777841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ec271-189b-427b-8699-c3143044af66 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:41.779236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ec271-189b-427b-8699-c3143044af66 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:41.782012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ec271-189b-427b-8699-c3143044af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:41.815545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f25a-9b13-482a-9588-602ad10b3357 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:41.839830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3443a68-b20f-46b4-85a3-50d8a13729be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:41.843820 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3443a68-b20f-46b4-85a3-50d8a13729be service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:41.844187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3443a68-b20f-46b4-85a3-50d8a13729be service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:41.844536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3443a68-b20f-46b4-85a3-50d8a13729be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:41.874296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3443a68-b20f-46b4-85a3-50d8a13729be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:41.878580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3443a68-b20f-46b4-85a3-50d8a13729be service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:41.895078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 861/1726] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:41 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:41.896220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3443a68-b20f-46b4-85a3-50d8a13729be service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:41.917845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3443a68-b20f-46b4-85a3-50d8a13729be service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:41.949830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcad81-a2ef-4e74-998d-109a991981cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:41.950482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcad81-a2ef-4e74-998d-109a991981cd admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:41.950767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcad81-a2ef-4e74-998d-109a991981cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:41.951278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcad81-a2ef-4e74-998d-109a991981cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:41.952088 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcad81-a2ef-4e74-998d-109a991981cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:41.954962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcad81-a2ef-4e74-998d-109a991981cd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:41.958840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d67ec271-189b-427b-8699-c3143044af66 None None] MFA Rules not processed for user `c426cc367a1843d38978d3b8e636276e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:41.965516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d67ec271-189b-427b-8699-c3143044af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:42.036159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 862/1727] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:41 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:42.036484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcad81-a2ef-4e74-998d-109a991981cd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:42.123353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 866/1728] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:40:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:42.128699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a899-902b-49f8-ae06-8f37c4337143 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.138121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a899-902b-49f8-ae06-8f37c4337143 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.138121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25a899-902b-49f8-ae06-8f37c4337143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.187652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1a25a899-902b-49f8-ae06-8f37c4337143 None None] MFA Rules not processed for user `3264fa6c4cea48ba89955c9bb0c233ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:42.188987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1a25a899-902b-49f8-ae06-8f37c4337143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:42.264531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcad81-a2ef-4e74-998d-109a991981cd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:42.279757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068d40e-9b63-4262-baae-2ee40f64e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:42.280824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068d40e-9b63-4262-baae-2ee40f64e5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.280824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068d40e-9b63-4262-baae-2ee40f64e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.281092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068d40e-9b63-4262-baae-2ee40f64e5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.281719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068d40e-9b63-4262-baae-2ee40f64e5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:42.283713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068d40e-9b63-4262-baae-2ee40f64e5c9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:42.334325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 867/1729] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:42.336742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a899-902b-49f8-ae06-8f37c4337143 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:42.354699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25a899-902b-49f8-ae06-8f37c4337143 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:42.360787 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06b862-f2b3-4f9c-99f7-a1f36a0dad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:42.362001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06b862-f2b3-4f9c-99f7-a1f36a0dad70 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.362402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06b862-f2b3-4f9c-99f7-a1f36a0dad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.363741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06b862-f2b3-4f9c-99f7-a1f36a0dad70 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.363741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06b862-f2b3-4f9c-99f7-a1f36a0dad70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:42.369295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 863/1730] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:42 2022] POST /identity/v3/projects => generated 365 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:42.369450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06b862-f2b3-4f9c-99f7-a1f36a0dad70 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:42.369663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326e36-0caf-4f01-87fc-febb7c040334 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.369966 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326e36-0caf-4f01-87fc-febb7c040334 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.370246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326e36-0caf-4f01-87fc-febb7c040334 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.374088 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 864/1731] 10.222.0.57 () {54 vars in 912 bytes} [Thu Aug 4 04:40:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:40:42.375059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326e36-0caf-4f01-87fc-febb7c040334 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:42.376766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8e326e36-0caf-4f01-87fc-febb7c040334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:42.404226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 868/1732] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:42 2022] POST /identity/v3/users => generated 296 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:42.405135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06b862-f2b3-4f9c-99f7-a1f36a0dad70 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:42.421572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06b862-f2b3-4f9c-99f7-a1f36a0dad70 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:42.469513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326e36-0caf-4f01-87fc-febb7c040334 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:42.478031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9cb3e-a4e5-40e0-bde1-c234126bad24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:42.479305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9cb3e-a4e5-40e0-bde1-c234126bad24 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.479738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9cb3e-a4e5-40e0-bde1-c234126bad24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.480176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9cb3e-a4e5-40e0-bde1-c234126bad24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.491226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9cb3e-a4e5-40e0-bde1-c234126bad24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:42.493639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9cb3e-a4e5-40e0-bde1-c234126bad24 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:42.505570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:42.510739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 865/1733] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:42.516432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:42.517408 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.517829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.518242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] PATH_INFO: `/v3/users/595cf62f66f3484688771031da5dd7dd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.521808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=595cf62f66f3484688771031da5dd7dd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:42.527155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:42.536898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475df6-dcbf-4dde-a2a6-f6367b6b53e9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.537232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475df6-dcbf-4dde-a2a6-f6367b6b53e9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.538934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475df6-dcbf-4dde-a2a6-f6367b6b53e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.588348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3c475df6-dcbf-4dde-a2a6-f6367b6b53e9 None None] MFA Rules not processed for user `d6a6f20d09bc4d5abc7c2a7fc02376b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:42.590515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3c475df6-dcbf-4dde-a2a6-f6367b6b53e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:42.600209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:42.614539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '595cf62f66f3484688771031da5dd7dd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:42.616677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '595cf62f66f3484688771031da5dd7dd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:42.648474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '595cf62f66f3484688771031da5dd7dd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:42.667347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '595cf62f66f3484688771031da5dd7dd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:42.684601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '595cf62f66f3484688771031da5dd7dd'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:42.692341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 869/1734] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:42 2022] DELETE /identity/v3/users/595cf62f66f3484688771031da5dd7dd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:42.693402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:42.703382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 866/1735] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:42.704350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:42.705272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3fa47-7978-4738-9521-03d95cc0701c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.705866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3fa47-7978-4738-9521-03d95cc0701c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.706955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3fa47-7978-4738-9521-03d95cc0701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.739110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a4e3fa47-7978-4738-9521-03d95cc0701c None None] MFA Rules not processed for user `c426cc367a1843d38978d3b8e636276e`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:42.740844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a4e3fa47-7978-4738-9521-03d95cc0701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:42.817636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66998561-3842-4070-a734-c155d671ee10 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:42.829316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 867/1736] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:40:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:42.830613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3fa47-7978-4738-9521-03d95cc0701c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:42.833145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a4e3fa47-7978-4738-9521-03d95cc0701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:42.845941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4c7a0-89ab-4c26-b630-aa063e2b5db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:42.846669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4c7a0-89ab-4c26-b630-aa063e2b5db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.847246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4c7a0-89ab-4c26-b630-aa063e2b5db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.847597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4c7a0-89ab-4c26-b630-aa063e2b5db6 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.848370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4c7a0-89ab-4c26-b630-aa063e2b5db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:42.850318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4c7a0-89ab-4c26-b630-aa063e2b5db6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:42.858183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3fa47-7978-4738-9521-03d95cc0701c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:42.864882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090b51-5331-4c02-9730-395e29ba2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:42.865973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090b51-5331-4c02-9730-395e29ba2ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.866702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090b51-5331-4c02-9730-395e29ba2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.868008 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090b51-5331-4c02-9730-395e29ba2ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.868983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090b51-5331-4c02-9730-395e29ba2ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:42.873209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090b51-5331-4c02-9730-395e29ba2ac1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:42.892383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 868/1737] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:42.892515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 870/1738] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:42 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:42.893865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090b51-5331-4c02-9730-395e29ba2ac1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:42.895637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206cb42-12f9-45da-b96f-3b5402640fab None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.895927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206cb42-12f9-45da-b96f-3b5402640fab None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.896893 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9a090b51-5331-4c02-9730-395e29ba2ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:42.899282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206cb42-12f9-45da-b96f-3b5402640fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.917313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090b51-5331-4c02-9730-395e29ba2ac1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:42.924723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237c6ba-d47f-4bb1-b942-8b0df807ad37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:42.925515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237c6ba-d47f-4bb1-b942-8b0df807ad37 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.926050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237c6ba-d47f-4bb1-b942-8b0df807ad37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.926346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237c6ba-d47f-4bb1-b942-8b0df807ad37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.936666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c206cb42-12f9-45da-b96f-3b5402640fab None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:42.937873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237c6ba-d47f-4bb1-b942-8b0df807ad37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:42.938238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c206cb42-12f9-45da-b96f-3b5402640fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:42.939550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237c6ba-d47f-4bb1-b942-8b0df807ad37 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:42.947096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 871/1739] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:42.947720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206cb42-12f9-45da-b96f-3b5402640fab None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:42.954578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 869/1740] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:42.956012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237c6ba-d47f-4bb1-b942-8b0df807ad37 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:42.973583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237c6ba-d47f-4bb1-b942-8b0df807ad37 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:42.982075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38098f2-95dd-4fab-a72f-bae315cf83f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:42.983019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38098f2-95dd-4fab-a72f-bae315cf83f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:42.984023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38098f2-95dd-4fab-a72f-bae315cf83f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:42.984474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38098f2-95dd-4fab-a72f-bae315cf83f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:42.985710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38098f2-95dd-4fab-a72f-bae315cf83f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:42.988095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38098f2-95dd-4fab-a72f-bae315cf83f8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:43.010639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 870/1741] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:43.010639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38098f2-95dd-4fab-a72f-bae315cf83f8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:43.010879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206cb42-12f9-45da-b96f-3b5402640fab None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:43.032759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38098f2-95dd-4fab-a72f-bae315cf83f8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:43.033048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d3054-e813-4c63-96fa-20d78c94ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:43.033689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3054-e813-4c63-96fa-20d78c94ec67 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.033975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3054-e813-4c63-96fa-20d78c94ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.034248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3054-e813-4c63-96fa-20d78c94ec67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.034957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d3054-e813-4c63-96fa-20d78c94ec67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:43.036601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d3054-e813-4c63-96fa-20d78c94ec67 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:43.045519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be5828-6348-491a-84d4-9e5ae98167f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:43.046169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be5828-6348-491a-84d4-9e5ae98167f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.046453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be5828-6348-491a-84d4-9e5ae98167f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.046883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be5828-6348-491a-84d4-9e5ae98167f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.075551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be5828-6348-491a-84d4-9e5ae98167f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:43.079747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be5828-6348-491a-84d4-9e5ae98167f0 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:43.095621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 872/1742] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:43.096591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d3054-e813-4c63-96fa-20d78c94ec67 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:43.102325 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 871/1743] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:43.103194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be5828-6348-491a-84d4-9e5ae98167f0 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:43.130456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be5828-6348-491a-84d4-9e5ae98167f0 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:43.132264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d3054-e813-4c63-96fa-20d78c94ec67 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:43.140569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ca39-fa27-43ed-9110-6bc3e9800f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:43.142385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ca39-fa27-43ed-9110-6bc3e9800f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.142671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ca39-fa27-43ed-9110-6bc3e9800f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.143725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ca39-fa27-43ed-9110-6bc3e9800f8b admin admin] PATH_INFO: `/v3/projects/6e073fbb87974a488af8e35eac1eeb70/users/041e7c10bedc4f8d9de0111d6aff39a1/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.149441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5c2f-0aea-415f-95b3-70e7b080e646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:43.150431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5c2f-0aea-415f-95b3-70e7b080e646 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.150907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5c2f-0aea-415f-95b3-70e7b080e646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.151455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5c2f-0aea-415f-95b3-70e7b080e646 admin admin] PATH_INFO: `/v3/projects/892f17db590d4e429ea8a7e185f4778f/users/bbad0920ae704270b9f58169871855ae/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.182825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8ca39-fa27-43ed-9110-6bc3e9800f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e073fbb87974a488af8e35eac1eeb70, user_id=041e7c10bedc4f8d9de0111d6aff39a1, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:43.200393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8ca39-fa27-43ed-9110-6bc3e9800f8b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:43.200664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5c2f-0aea-415f-95b3-70e7b080e646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=892f17db590d4e429ea8a7e185f4778f, user_id=bbad0920ae704270b9f58169871855ae, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:43.201075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5c2f-0aea-415f-95b3-70e7b080e646 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:43.229094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 872/1744] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:43 2022] PUT /identity/v3/projects/6e073fbb87974a488af8e35eac1eeb70/users/041e7c10bedc4f8d9de0111d6aff39a1/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:43.240068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c919d9-7f44-493f-9d07-6f743d289f2b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.240523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c919d9-7f44-493f-9d07-6f743d289f2b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.240987 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c919d9-7f44-493f-9d07-6f743d289f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.243257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 873/1745] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:43 2022] PUT /identity/v3/projects/892f17db590d4e429ea8a7e185f4778f/users/bbad0920ae704270b9f58169871855ae/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:43.245156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5c2f-0aea-415f-95b3-70e7b080e646 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:43.318404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d7c919d9-7f44-493f-9d07-6f743d289f2b None None] MFA Rules not processed for user `041e7c10bedc4f8d9de0111d6aff39a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:43.322439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d7c919d9-7f44-493f-9d07-6f743d289f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:43.330107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:43.440170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5c2f-0aea-415f-95b3-70e7b080e646 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:43.448887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbeab7-ab33-4a2a-a3d2-f8e8752d5b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:43.449908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbeab7-ab33-4a2a-a3d2-f8e8752d5b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.450921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbeab7-ab33-4a2a-a3d2-f8e8752d5b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.451747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbeab7-ab33-4a2a-a3d2-f8e8752d5b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.452821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbeab7-ab33-4a2a-a3d2-f8e8752d5b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:43.456286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbeab7-ab33-4a2a-a3d2-f8e8752d5b8b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:43.476661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 874/1746] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:43.477797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbeab7-ab33-4a2a-a3d2-f8e8752d5b8b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:43.478125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:43.481722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c9dbeab7-ab33-4a2a-a3d2-f8e8752d5b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:43.525934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 873/1747] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:40:43.527084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1e201-bcee-42c8-af26-f60715d85376 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.527490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1e201-bcee-42c8-af26-f60715d85376 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.528232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1e201-bcee-42c8-af26-f60715d85376 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.537144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 874/1748] 10.222.0.57 () {54 vars in 961 bytes} [Thu Aug 4 04:40:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:40:43.538508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1e201-bcee-42c8-af26-f60715d85376 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:43.560617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1e201-bcee-42c8-af26-f60715d85376 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:43.586197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa93e2-2ba2-445c-91cf-067950ea24b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:43.588314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa93e2-2ba2-445c-91cf-067950ea24b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.588604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa93e2-2ba2-445c-91cf-067950ea24b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.588884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa93e2-2ba2-445c-91cf-067950ea24b0 admin admin] PATH_INFO: `/v3/projects/892f17db590d4e429ea8a7e185f4778f/users/bbad0920ae704270b9f58169871855ae/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.594437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbeab7-ab33-4a2a-a3d2-f8e8752d5b8b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:43.595147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa93e2-2ba2-445c-91cf-067950ea24b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=892f17db590d4e429ea8a7e185f4778f, user_id=bbad0920ae704270b9f58169871855ae, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:43.607620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa93e2-2ba2-445c-91cf-067950ea24b0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:43.624890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45cc79-ce73-45be-8548-be5137a89df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:43.625271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 875/1749] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:43 2022] PUT /identity/v3/projects/892f17db590d4e429ea8a7e185f4778f/users/bbad0920ae704270b9f58169871855ae/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:43.626203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa93e2-2ba2-445c-91cf-067950ea24b0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:43.627616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45cc79-ce73-45be-8548-be5137a89df8 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.627972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45cc79-ce73-45be-8548-be5137a89df8 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.628338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45cc79-ce73-45be-8548-be5137a89df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.638942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5d45cc79-ce73-45be-8548-be5137a89df8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:43.770893 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa93e2-2ba2-445c-91cf-067950ea24b0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:43.790355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1eb75-5182-4d97-90c4-00b73d1631f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:43.791424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1eb75-5182-4d97-90c4-00b73d1631f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.791830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1eb75-5182-4d97-90c4-00b73d1631f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.792169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1eb75-5182-4d97-90c4-00b73d1631f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.793421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1eb75-5182-4d97-90c4-00b73d1631f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:43.797027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1eb75-5182-4d97-90c4-00b73d1631f7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:43.800512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45cc79-ce73-45be-8548-be5137a89df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:43.802294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45cc79-ce73-45be-8548-be5137a89df8 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:43.821977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 875/1750] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:43.824408 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb0ee0-7e0d-4151-972d-181afecf8131 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.824408 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb0ee0-7e0d-4151-972d-181afecf8131 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.824408 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb0ee0-7e0d-4151-972d-181afecf8131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.877172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 876/1751] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:43 2022] POST /identity/v3/projects => generated 391 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:43.877172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6e22e-ec43-4f84-994f-e9cb1f7db887 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:43.877172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6e22e-ec43-4f84-994f-e9cb1f7db887 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:43.877172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6e22e-ec43-4f84-994f-e9cb1f7db887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:43.883750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2ceb0ee0-7e0d-4151-972d-181afecf8131 None None] MFA Rules not processed for user `a5c20a5a655b43d1899bf2319647a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:43.889090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2ceb0ee0-7e0d-4151-972d-181afecf8131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:43.974288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-52f6e22e-ec43-4f84-994f-e9cb1f7db887 None None] MFA Rules not processed for user `bbad0920ae704270b9f58169871855ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:43.978286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-52f6e22e-ec43-4f84-994f-e9cb1f7db887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:44.009360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:44.050368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 876/1752] 10.222.0.57 () {58 vars in 1058 bytes} [Thu Aug 4 04:40:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:44.051262 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb0ee0-7e0d-4151-972d-181afecf8131 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:44.220785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 877/1753] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:44.221860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb0ee0-7e0d-4151-972d-181afecf8131 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:44.229509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6e22e-ec43-4f84-994f-e9cb1f7db887 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:44.231944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-52f6e22e-ec43-4f84-994f-e9cb1f7db887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:44.240654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62983572-b682-4204-9259-4c0a222f304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:44.243398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62983572-b682-4204-9259-4c0a222f304f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:44.244361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62983572-b682-4204-9259-4c0a222f304f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:44.246568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62983572-b682-4204-9259-4c0a222f304f admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:44.247835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62983572-b682-4204-9259-4c0a222f304f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:44.255225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62983572-b682-4204-9259-4c0a222f304f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:44.271549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6e22e-ec43-4f84-994f-e9cb1f7db887 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:44.278795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:44.279778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:44.280310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:44.280984 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] PATH_INFO: `/v3/projects/7d2fd8f42e48435fbeff8f863d34b47f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:44.298331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2fd8f42e48435fbeff8f863d34b47f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:44.304016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:44.307541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 877/1754] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:44 2022] POST /identity/v3/users => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:44.308476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62983572-b682-4204-9259-4c0a222f304f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:44.343561 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62983572-b682-4204-9259-4c0a222f304f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:44.358833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:44.359533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:44.359814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:44.360089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:44.361980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:44.392298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:44.395043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:44.424791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:44.432858 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 878/1755] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:44.437544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:44.441972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2fd8f42e48435fbeff8f863d34b47f', 'request_id': 'req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:44.442931 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:44.451987 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2fd8f42e48435fbeff8f863d34b47f', 'request_id': 'req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:44.462022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2fd8f42e48435fbeff8f863d34b47f', 'request_id': 'req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:44.487378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] The token cache is being invalidate because project 7d2fd8f42e48435fbeff8f863d34b47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:44.487689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:44.488544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:44.493541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 878/1756] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:44 2022] DELETE /identity/v3/projects/7d2fd8f42e48435fbeff8f863d34b47f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:44.493541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:44.493541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:44.496700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca4925-0d8c-4e1b-be46-958d70908fa7 service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:44.611599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91b4e3-14f4-408e-94b5-2d0bb66a8759 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:44.634323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809edf-f811-4a3a-9645-c2babc3df3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:44.635000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809edf-f811-4a3a-9645-c2babc3df3ae service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:44.635460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809edf-f811-4a3a-9645-c2babc3df3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:44.635750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809edf-f811-4a3a-9645-c2babc3df3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:44.644730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-02809edf-f811-4a3a-9645-c2babc3df3ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:44.682388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:44.683322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:44.683904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:44.684327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:44.688169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:44.713371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:44.724563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:44.749361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 879/1757] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:44.751412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:44.760223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:44.792179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809edf-f811-4a3a-9645-c2babc3df3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:44.795164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809edf-f811-4a3a-9645-c2babc3df3ae service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:44.820305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 879/1758] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:44.825783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd2733-d5c2-44a8-9d52-fa58836eadf1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:44.827427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd2733-d5c2-44a8-9d52-fa58836eadf1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:44.827790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd2733-d5c2-44a8-9d52-fa58836eadf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:44.892558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8ecd2733-d5c2-44a8-9d52-fa58836eadf1 None None] MFA Rules not processed for user `41e527395daf428ab00fd78c2412ed13`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:44.894267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8ecd2733-d5c2-44a8-9d52-fa58836eadf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:44.992010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa93b2-7aa6-406e-abdf-699a570f3b97 service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:45.020836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27a017-5932-4307-9c0d-5492509c2ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:45.020836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27a017-5932-4307-9c0d-5492509c2ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:45.020836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27a017-5932-4307-9c0d-5492509c2ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:45.020836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27a017-5932-4307-9c0d-5492509c2ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:45.032793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27a017-5932-4307-9c0d-5492509c2ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:45.076994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27a017-5932-4307-9c0d-5492509c2ea8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:45.081598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 880/1759] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:45.082517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd2733-d5c2-44a8-9d52-fa58836eadf1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:45.084501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:45.086676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8ecd2733-d5c2-44a8-9d52-fa58836eadf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:45.144841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd2733-d5c2-44a8-9d52-fa58836eadf1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:45.159263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:45.159924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 880/1760] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:45.161539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:45.161833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:45.162112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] PATH_INFO: `/v3/users/e5b78a4d837e486fb52335afaf194eb0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:45.167215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27a017-5932-4307-9c0d-5492509c2ea8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:45.167541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b78a4d837e486fb52335afaf194eb0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:45.172947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0d27a017-5932-4307-9c0d-5492509c2ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:45.174230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:45.213273 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:45.231810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27a017-5932-4307-9c0d-5492509c2ea8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:45.241194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656d27d-7727-42e3-972f-07c0281a9b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:45.242036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656d27d-7727-42e3-972f-07c0281a9b64 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:45.252857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656d27d-7727-42e3-972f-07c0281a9b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:45.254649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656d27d-7727-42e3-972f-07c0281a9b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:45.274746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5656d27d-7727-42e3-972f-07c0281a9b64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:45.305351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b78a4d837e486fb52335afaf194eb0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:45.307271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b78a4d837e486fb52335afaf194eb0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:45.344006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b78a4d837e486fb52335afaf194eb0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:45.361837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b78a4d837e486fb52335afaf194eb0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:45.363104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b78a4d837e486fb52335afaf194eb0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:45.414301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 881/1761] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:45 2022] DELETE /identity/v3/users/e5b78a4d837e486fb52335afaf194eb0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:45.420177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:45.425981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:45.485853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656d27d-7727-42e3-972f-07c0281a9b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:45.491411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656d27d-7727-42e3-972f-07c0281a9b64 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:45.535108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 881/1762] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:45.625326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2a10f-a054-408f-8141-f3bd7955aa49 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:45.632755 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20ce6f-5d03-4f8c-8970-65431fa84425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:45.633764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ce6f-5d03-4f8c-8970-65431fa84425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:45.634631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ce6f-5d03-4f8c-8970-65431fa84425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:45.635811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ce6f-5d03-4f8c-8970-65431fa84425 admin admin] PATH_INFO: `/v3/projects/3155882f21d8445fa60477583661e0b8/users/c987866afd61488bb5c376f03ce8c3db/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:45.662854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20ce6f-5d03-4f8c-8970-65431fa84425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3155882f21d8445fa60477583661e0b8, user_id=c987866afd61488bb5c376f03ce8c3db, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:45.671161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20ce6f-5d03-4f8c-8970-65431fa84425 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:45.718522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 882/1763] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:45 2022] PUT /identity/v3/projects/3155882f21d8445fa60477583661e0b8/users/c987866afd61488bb5c376f03ce8c3db/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:45.723122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656d27d-7727-42e3-972f-07c0281a9b64 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:45.748003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656d27d-7727-42e3-972f-07c0281a9b64 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:45.935213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f5287-dc22-48e9-aaad-cfa66b8c8af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:45.937912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f5287-dc22-48e9-aaad-cfa66b8c8af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:45.938200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f5287-dc22-48e9-aaad-cfa66b8c8af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:45.938474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f5287-dc22-48e9-aaad-cfa66b8c8af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:45.939749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f5287-dc22-48e9-aaad-cfa66b8c8af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:45.947227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f5287-dc22-48e9-aaad-cfa66b8c8af7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:46.000347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 882/1764] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:46.004921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20ce6f-5d03-4f8c-8970-65431fa84425 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:46.057435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20ce6f-5d03-4f8c-8970-65431fa84425 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:46.073065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5277f5-e6a3-4df7-8d27-edc1414c0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:46.076852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5277f5-e6a3-4df7-8d27-edc1414c0a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:46.077147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5277f5-e6a3-4df7-8d27-edc1414c0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:46.077403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5277f5-e6a3-4df7-8d27-edc1414c0a0a admin admin] PATH_INFO: `/v3/projects/3155882f21d8445fa60477583661e0b8/users/c987866afd61488bb5c376f03ce8c3db/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:46.084641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5277f5-e6a3-4df7-8d27-edc1414c0a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3155882f21d8445fa60477583661e0b8, user_id=c987866afd61488bb5c376f03ce8c3db, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:46.087474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5277f5-e6a3-4df7-8d27-edc1414c0a0a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:46.128652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 883/1765] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:46 2022] PUT /identity/v3/projects/3155882f21d8445fa60477583661e0b8/users/c987866afd61488bb5c376f03ce8c3db/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:40:46.132518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7882a0-b557-43ff-a0d6-52e56931b842 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:46.132860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7882a0-b557-43ff-a0d6-52e56931b842 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:46.133177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7882a0-b557-43ff-a0d6-52e56931b842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:46.233444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ad7882a0-b557-43ff-a0d6-52e56931b842 None None] MFA Rules not processed for user `c987866afd61488bb5c376f03ce8c3db`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:46.234940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad7882a0-b557-43ff-a0d6-52e56931b842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:46.294785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5277f5-e6a3-4df7-8d27-edc1414c0a0a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:46.297493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1e5277f5-e6a3-4df7-8d27-edc1414c0a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:46.439997 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 883/1766] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:46.454483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7882a0-b557-43ff-a0d6-52e56931b842 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:46.456222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad7882a0-b557-43ff-a0d6-52e56931b842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:46.490019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:46.522293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5277f5-e6a3-4df7-8d27-edc1414c0a0a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:46.529073 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:46.530173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:46.530655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:46.531159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] PATH_INFO: `/v3/projects/481a86da85a7404f8bb5bbf8f256e033` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:46.532557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=481a86da85a7404f8bb5bbf8f256e033)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:46.535498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:46.537914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:46.605128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7882a0-b557-43ff-a0d6-52e56931b842 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:46.610171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307062dc-0453-4fec-b355-c118316a0ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:46.611265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307062dc-0453-4fec-b355-c118316a0ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:46.611771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307062dc-0453-4fec-b355-c118316a0ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:46.613033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307062dc-0453-4fec-b355-c118316a0ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:46.643915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307062dc-0453-4fec-b355-c118316a0ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:46.645355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307062dc-0453-4fec-b355-c118316a0ec2 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:46.649425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481a86da85a7404f8bb5bbf8f256e033', 'request_id': 'req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:46.664846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481a86da85a7404f8bb5bbf8f256e033', 'request_id': 'req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:46.674643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481a86da85a7404f8bb5bbf8f256e033', 'request_id': 'req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:46.687969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 884/1767] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:40:46.689104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307062dc-0453-4fec-b355-c118316a0ec2 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:46.691088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-307062dc-0453-4fec-b355-c118316a0ec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:46.724804 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307062dc-0453-4fec-b355-c118316a0ec2 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:46.725011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] The token cache is being invalidate because project 481a86da85a7404f8bb5bbf8f256e033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:46.726287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:46.727537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fcce7093-b9e1-403b-a0e0-1dea1e0ea917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:46.736433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 884/1768] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:46 2022] DELETE /identity/v3/projects/481a86da85a7404f8bb5bbf8f256e033 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:40:46.741885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbb249-fdf8-44bf-b605-51d2c76ac030 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:46.742678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbb249-fdf8-44bf-b605-51d2c76ac030 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:46.743667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbb249-fdf8-44bf-b605-51d2c76ac030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:46.835566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-79fbb249-fdf8-44bf-b605-51d2c76ac030 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:46.839450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-79fbb249-fdf8-44bf-b605-51d2c76ac030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:46.892547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea6f0e-39d7-4fa8-82ee-4f33a308069c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:46.893924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6f0e-39d7-4fa8-82ee-4f33a308069c service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:46.899592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6f0e-39d7-4fa8-82ee-4f33a308069c service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:46.900232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea6f0e-39d7-4fa8-82ee-4f33a308069c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:46.904504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-99ea6f0e-39d7-4fa8-82ee-4f33a308069c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:47.048564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 885/1769] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:47.050528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbb249-fdf8-44bf-b605-51d2c76ac030 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:47.066476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-79fbb249-fdf8-44bf-b605-51d2c76ac030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:47.105527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbb249-fdf8-44bf-b605-51d2c76ac030 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:47.113828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c283f1-884d-4415-8954-ec64feb990be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:47.115558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c283f1-884d-4415-8954-ec64feb990be service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:47.116939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c283f1-884d-4415-8954-ec64feb990be service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:47.117776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c283f1-884d-4415-8954-ec64feb990be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:47.124076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-12c283f1-884d-4415-8954-ec64feb990be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:47.144751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea6f0e-39d7-4fa8-82ee-4f33a308069c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:47.151871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea6f0e-39d7-4fa8-82ee-4f33a308069c service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:47.186011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 885/1770] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:47.189884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd1e21-12d5-4e12-8a2a-8e88ab513027 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:47.190220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd1e21-12d5-4e12-8a2a-8e88ab513027 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:47.190512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd1e21-12d5-4e12-8a2a-8e88ab513027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:47.256478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-53cd1e21-12d5-4e12-8a2a-8e88ab513027 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:47.264738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-53cd1e21-12d5-4e12-8a2a-8e88ab513027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:47.285196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 886/1771] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:47.289613 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd1e21-12d5-4e12-8a2a-8e88ab513027 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:47.296583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c283f1-884d-4415-8954-ec64feb990be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:47.304658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c283f1-884d-4415-8954-ec64feb990be service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:47.305390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd1e21-12d5-4e12-8a2a-8e88ab513027 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:47.315588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27acf9c-6cb2-4ee0-bf47-6ca8c5c0810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:47.316237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27acf9c-6cb2-4ee0-bf47-6ca8c5c0810c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:47.316520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27acf9c-6cb2-4ee0-bf47-6ca8c5c0810c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:47.316917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27acf9c-6cb2-4ee0-bf47-6ca8c5c0810c admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:47.319979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27acf9c-6cb2-4ee0-bf47-6ca8c5c0810c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:40:47.320297 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27acf9c-6cb2-4ee0-bf47-6ca8c5c0810c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:47.323663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27acf9c-6cb2-4ee0-bf47-6ca8c5c0810c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:47.333051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 886/1772] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:47.371100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 887/1773] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:40:47.372321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c283f1-884d-4415-8954-ec64feb990be service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:47.391183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c283f1-884d-4415-8954-ec64feb990be service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:47.400573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8bf29-f8e0-48c7-8663-d33c45f0ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:47.403342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8bf29-f8e0-48c7-8663-d33c45f0ac19 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:47.403814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8bf29-f8e0-48c7-8663-d33c45f0ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:47.404277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8bf29-f8e0-48c7-8663-d33c45f0ac19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:47.405154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8bf29-f8e0-48c7-8663-d33c45f0ac19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:47.414239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8bf29-f8e0-48c7-8663-d33c45f0ac19 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:47.490090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 887/1774] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:47 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:40:47.493817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27acf9c-6cb2-4ee0-bf47-6ca8c5c0810c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:47.510282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27acf9c-6cb2-4ee0-bf47-6ca8c5c0810c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:47.620276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:47.671350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130eab5-c058-47fa-b6cd-38acd09ae762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:47.687969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130eab5-c058-47fa-b6cd-38acd09ae762 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:47.692788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130eab5-c058-47fa-b6cd-38acd09ae762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:47.693135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130eab5-c058-47fa-b6cd-38acd09ae762 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:47.693875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130eab5-c058-47fa-b6cd-38acd09ae762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:47.700659 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130eab5-c058-47fa-b6cd-38acd09ae762 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:47.824261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 888/1775] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:47 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:47.825312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8bf29-f8e0-48c7-8663-d33c45f0ac19 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:47.839773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8bf29-f8e0-48c7-8663-d33c45f0ac19 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:47.853871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5a26f-3513-4783-928d-56c98010566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:47.854486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5a26f-3513-4783-928d-56c98010566a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:47.855209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5a26f-3513-4783-928d-56c98010566a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:47.856854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5a26f-3513-4783-928d-56c98010566a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:47.857588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5a26f-3513-4783-928d-56c98010566a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:47.862857 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5a26f-3513-4783-928d-56c98010566a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:47.870828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:47.893192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130eab5-c058-47fa-b6cd-38acd09ae762 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:47.894768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 888/1776] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:47.914758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130eab5-c058-47fa-b6cd-38acd09ae762 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:47.931502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de455c6-57cd-4d00-8fd5-9f71f51fc838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:47.932591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de455c6-57cd-4d00-8fd5-9f71f51fc838 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:47.933706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de455c6-57cd-4d00-8fd5-9f71f51fc838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:47.934154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de455c6-57cd-4d00-8fd5-9f71f51fc838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:47.936268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de455c6-57cd-4d00-8fd5-9f71f51fc838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:47.941268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de455c6-57cd-4d00-8fd5-9f71f51fc838 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:47.988860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 889/1777] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:47.992272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5a26f-3513-4783-928d-56c98010566a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:48.007494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5a26f-3513-4783-928d-56c98010566a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:48.021241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04488f7-260f-40c6-aebd-a792f95f8d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:48.022455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04488f7-260f-40c6-aebd-a792f95f8d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:48.023271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04488f7-260f-40c6-aebd-a792f95f8d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:48.024067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04488f7-260f-40c6-aebd-a792f95f8d6f admin admin] PATH_INFO: `/v3/projects/df1390b3c381490499f7f50a08ef2a92/users/362f56d066674ff5adaf5a4fca270e4a/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:48.069779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04488f7-260f-40c6-aebd-a792f95f8d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1390b3c381490499f7f50a08ef2a92, user_id=362f56d066674ff5adaf5a4fca270e4a, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:48.075751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04488f7-260f-40c6-aebd-a792f95f8d6f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:48.126522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 889/1778] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:47 2022] PUT /identity/v3/projects/df1390b3c381490499f7f50a08ef2a92/users/362f56d066674ff5adaf5a4fca270e4a/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:48.140734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cfeff-f8cb-4ed9-892f-517b972bef01 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:48.141443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cfeff-f8cb-4ed9-892f-517b972bef01 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:48.141912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cfeff-f8cb-4ed9-892f-517b972bef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:48.272871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c14cfeff-f8cb-4ed9-892f-517b972bef01 None None] MFA Rules not processed for user `362f56d066674ff5adaf5a4fca270e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:48.279569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c14cfeff-f8cb-4ed9-892f-517b972bef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:48.550212 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 890/1779] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:40:48.556634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04488f7-260f-40c6-aebd-a792f95f8d6f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:48.847810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04488f7-260f-40c6-aebd-a792f95f8d6f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:48.875225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b9e64-50b9-4df3-85cd-bb9205c8bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:48.876225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b9e64-50b9-4df3-85cd-bb9205c8bf65 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:48.878848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b9e64-50b9-4df3-85cd-bb9205c8bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:48.880211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b9e64-50b9-4df3-85cd-bb9205c8bf65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:48.881149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b9e64-50b9-4df3-85cd-bb9205c8bf65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:48.893426 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b9e64-50b9-4df3-85cd-bb9205c8bf65 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:49.021095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cfeff-f8cb-4ed9-892f-517b972bef01 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:49.051523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 890/1780] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:40:48 2022] POST /identity/v3/projects => generated 371 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:40:49.072318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cfeff-f8cb-4ed9-892f-517b972bef01 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:49.095388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4f48-f784-4b4e-9cef-c450d528ef79 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:49.096013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4f48-f784-4b4e-9cef-c450d528ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:49.096507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4f48-f784-4b4e-9cef-c450d528ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:49.324716 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795b18e-076a-4b55-9ad4-3afd493ba46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:49.326036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795b18e-076a-4b55-9ad4-3afd493ba46e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:49.326541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795b18e-076a-4b55-9ad4-3afd493ba46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:49.326950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795b18e-076a-4b55-9ad4-3afd493ba46e admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:49.327857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795b18e-076a-4b55-9ad4-3afd493ba46e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:49.331451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795b18e-076a-4b55-9ad4-3afd493ba46e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:49.352630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2abb4f48-f784-4b4e-9cef-c450d528ef79 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:49.355480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2abb4f48-f784-4b4e-9cef-c450d528ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:49.384496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 891/1781] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:40:49 2022] POST /identity/v3/users => generated 292 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:40:49.387113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795b18e-076a-4b55-9ad4-3afd493ba46e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:49.409577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795b18e-076a-4b55-9ad4-3afd493ba46e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:49.424101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623b5e4-5edf-4aef-880b-b406be5742db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:49.424777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623b5e4-5edf-4aef-880b-b406be5742db admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:49.425107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623b5e4-5edf-4aef-880b-b406be5742db admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:49.425382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623b5e4-5edf-4aef-880b-b406be5742db admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:49.426132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623b5e4-5edf-4aef-880b-b406be5742db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:49.427899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623b5e4-5edf-4aef-880b-b406be5742db admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:49.458435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 892/1782] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:49.463228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623b5e4-5edf-4aef-880b-b406be5742db admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:49.498026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623b5e4-5edf-4aef-880b-b406be5742db admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:49.518827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cebdc-53f1-4650-b05b-1d8a7f5a7241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:49.519836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cebdc-53f1-4650-b05b-1d8a7f5a7241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:49.521160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cebdc-53f1-4650-b05b-1d8a7f5a7241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:49.522366 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cebdc-53f1-4650-b05b-1d8a7f5a7241 admin admin] PATH_INFO: `/v3/projects/266007809ef747fbb87a9f28cd7d05c8/users/2338ac239bea4a84a20f11afa714d31f/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:49.594079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cebdc-53f1-4650-b05b-1d8a7f5a7241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266007809ef747fbb87a9f28cd7d05c8, user_id=2338ac239bea4a84a20f11afa714d31f, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:49.598925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 891/1783] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:40:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:40:49.601308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cebdc-53f1-4650-b05b-1d8a7f5a7241 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:49.605837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea777d1-9e90-4437-8478-00b42d9764b4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:49.606140 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea777d1-9e90-4437-8478-00b42d9764b4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:49.606419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea777d1-9e90-4437-8478-00b42d9764b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:49.672964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 893/1784] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:49 2022] PUT /identity/v3/projects/266007809ef747fbb87a9f28cd7d05c8/users/2338ac239bea4a84a20f11afa714d31f/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:49.678807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cebdc-53f1-4650-b05b-1d8a7f5a7241 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:49.713296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9ea777d1-9e90-4437-8478-00b42d9764b4 None None] MFA Rules not processed for user `3264fa6c4cea48ba89955c9bb0c233ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:49.718823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:49.720411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9ea777d1-9e90-4437-8478-00b42d9764b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:49.791550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:49.828490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cebdc-53f1-4650-b05b-1d8a7f5a7241 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:49.840006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdea4b2-db51-4f13-af6b-33862aee534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:49.840900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdea4b2-db51-4f13-af6b-33862aee534c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:49.841337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdea4b2-db51-4f13-af6b-33862aee534c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:49.841689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdea4b2-db51-4f13-af6b-33862aee534c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:49.842462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdea4b2-db51-4f13-af6b-33862aee534c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:49.850963 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdea4b2-db51-4f13-af6b-33862aee534c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:49.880110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 894/1785] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:40:49.884438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdea4b2-db51-4f13-af6b-33862aee534c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:49.910949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdea4b2-db51-4f13-af6b-33862aee534c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:49.917912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 892/1786] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:49.924077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea777d1-9e90-4437-8478-00b42d9764b4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:49.927892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9ea777d1-9e90-4437-8478-00b42d9764b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:49.935477 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754b99-0d0d-4d36-a02f-5bd007ed1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:49.937459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754b99-0d0d-4d36-a02f-5bd007ed1302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:49.938658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754b99-0d0d-4d36-a02f-5bd007ed1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:49.940134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754b99-0d0d-4d36-a02f-5bd007ed1302 admin admin] PATH_INFO: `/v3/projects/266007809ef747fbb87a9f28cd7d05c8/users/2338ac239bea4a84a20f11afa714d31f/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:49.944870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754b99-0d0d-4d36-a02f-5bd007ed1302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266007809ef747fbb87a9f28cd7d05c8, user_id=2338ac239bea4a84a20f11afa714d31f, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:49.951323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754b99-0d0d-4d36-a02f-5bd007ed1302 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:49.994856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 895/1787] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:40:49 2022] PUT /identity/v3/projects/266007809ef747fbb87a9f28cd7d05c8/users/2338ac239bea4a84a20f11afa714d31f/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:50.010106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0600f7-9f69-47da-a3e6-f7f83f684b14 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:50.010921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0600f7-9f69-47da-a3e6-f7f83f684b14 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:50.011443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0600f7-9f69-47da-a3e6-f7f83f684b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:50.109543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3e0600f7-9f69-47da-a3e6-f7f83f684b14 None None] MFA Rules not processed for user `2338ac239bea4a84a20f11afa714d31f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:50.112878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3e0600f7-9f69-47da-a3e6-f7f83f684b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:50.254074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea777d1-9e90-4437-8478-00b42d9764b4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:50.353508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 896/1788] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:50.451529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2d726-17b5-493c-a05d-b4ad907e6e0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:50.452190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d726-17b5-493c-a05d-b4ad907e6e0b service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:50.452473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d726-17b5-493c-a05d-b4ad907e6e0b service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:50.452746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d726-17b5-493c-a05d-b4ad907e6e0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:50.574305 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0600f7-9f69-47da-a3e6-f7f83f684b14 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:50.703383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2d726-17b5-493c-a05d-b4ad907e6e0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:50.708414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2d726-17b5-493c-a05d-b4ad907e6e0b service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:50.722082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:50.738918 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 893/1789] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:40:50.751046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0600f7-9f69-47da-a3e6-f7f83f684b14 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:50.789544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f1d3-fb15-44bf-8121-17d04e4ecbbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:50.790151 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f1d3-fb15-44bf-8121-17d04e4ecbbf service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:50.790443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f1d3-fb15-44bf-8121-17d04e4ecbbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:50.790971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f1d3-fb15-44bf-8121-17d04e4ecbbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:50.823309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216f1d3-fb15-44bf-8121-17d04e4ecbbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:50.844843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216f1d3-fb15-44bf-8121-17d04e4ecbbf service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:50.893971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 897/1790] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:40:51.421079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2d726-17b5-493c-a05d-b4ad907e6e0b service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:51.423712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-51a2d726-17b5-493c-a05d-b4ad907e6e0b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:51.513661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f1d3-fb15-44bf-8121-17d04e4ecbbf service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:51.515361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6216f1d3-fb15-44bf-8121-17d04e4ecbbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:51.552741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f1d3-fb15-44bf-8121-17d04e4ecbbf service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:51.572519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3f46-186e-427c-9fda-ee5d093bcf6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:51.573167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3f46-186e-427c-9fda-ee5d093bcf6d service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:51.573444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3f46-186e-427c-9fda-ee5d093bcf6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:51.580417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3f46-186e-427c-9fda-ee5d093bcf6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:51.685398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2d726-17b5-493c-a05d-b4ad907e6e0b service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:51.707275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:51.712041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:51.712523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:51.712833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] PATH_INFO: `/v3/users/e7a5c93920e042188f275d365880f8de` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:51.726888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a5c93920e042188f275d365880f8de)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:51.726888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:51.728095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:51.847985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c3f46-186e-427c-9fda-ee5d093bcf6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:51.849946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c3f46-186e-427c-9fda-ee5d093bcf6d service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:51.883304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a5c93920e042188f275d365880f8de'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:51.886372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a5c93920e042188f275d365880f8de'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:51.896215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 898/1791] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:51.932090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a5c93920e042188f275d365880f8de'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:51.966539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a5c93920e042188f275d365880f8de'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:51.968040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f09e79ed-0f8f-4155-b72b-33c0790cb6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a5c93920e042188f275d365880f8de'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:52.021276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 894/1792] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:51 2022] DELETE /identity/v3/users/e7a5c93920e042188f275d365880f8de => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:52.027916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3f46-186e-427c-9fda-ee5d093bcf6d service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:52.029079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cc1c3f46-186e-427c-9fda-ee5d093bcf6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:52.029845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e85994-8029-454a-bb74-ae7325db4036 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:52.030281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e85994-8029-454a-bb74-ae7325db4036 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:52.030861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e85994-8029-454a-bb74-ae7325db4036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:52.076209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3f46-186e-427c-9fda-ee5d093bcf6d service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:52.115050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-33e85994-8029-454a-bb74-ae7325db4036 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:52.121207 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-33e85994-8029-454a-bb74-ae7325db4036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:52.333081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 895/1793] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:52.351955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e85994-8029-454a-bb74-ae7325db4036 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:52.353815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-33e85994-8029-454a-bb74-ae7325db4036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:52.371718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:52.373029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:52.373029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:52.373283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] PATH_INFO: `/v3/users/6fe739698b7b4b69b9adbdc9e2c9e7c2` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:52.387223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe739698b7b4b69b9adbdc9e2c9e7c2)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:52.389192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:52.413679 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:52.547331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe739698b7b4b69b9adbdc9e2c9e7c2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:52.564298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe739698b7b4b69b9adbdc9e2c9e7c2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:52.587993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e85994-8029-454a-bb74-ae7325db4036 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:52.596462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe739698b7b4b69b9adbdc9e2c9e7c2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:52.598842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd1447-b528-4201-b139-6aa6a9094313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:52.601313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd1447-b528-4201-b139-6aa6a9094313 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:52.602307 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd1447-b528-4201-b139-6aa6a9094313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:52.603249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd1447-b528-4201-b139-6aa6a9094313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:52.618662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe739698b7b4b69b9adbdc9e2c9e7c2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:52.630855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd1447-b528-4201-b139-6aa6a9094313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:52.633171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd1447-b528-4201-b139-6aa6a9094313 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:52.636750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0450e690-9e8e-479c-8cee-b3805e50350d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe739698b7b4b69b9adbdc9e2c9e7c2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:52.651473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 899/1794] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:52 2022] DELETE /identity/v3/users/6fe739698b7b4b69b9adbdc9e2c9e7c2 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:52.656835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376f3d-0d8e-46a1-9fa9-3f48d1f180b6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:52.657454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376f3d-0d8e-46a1-9fa9-3f48d1f180b6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:52.657977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376f3d-0d8e-46a1-9fa9-3f48d1f180b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:52.663361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 896/1795] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:52.686933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a8376f3d-0d8e-46a1-9fa9-3f48d1f180b6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:52.688657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a8376f3d-0d8e-46a1-9fa9-3f48d1f180b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:52.787450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:52.837281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 900/1796] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:52.921798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd1447-b528-4201-b139-6aa6a9094313 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:52.935290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd1447-b528-4201-b139-6aa6a9094313 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:53.128724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804f93-0684-4e94-95b4-05631b8e1f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:53.132466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804f93-0684-4e94-95b4-05631b8e1f37 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:53.133383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804f93-0684-4e94-95b4-05631b8e1f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:53.134033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804f93-0684-4e94-95b4-05631b8e1f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:53.167723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75804f93-0684-4e94-95b4-05631b8e1f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:53.170878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75804f93-0684-4e94-95b4-05631b8e1f37 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:53.191704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 897/1797] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:53.563813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1f2a-2960-4559-a343-3d594e51afd4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:53.565164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1f2a-2960-4559-a343-3d594e51afd4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:53.565694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1f2a-2960-4559-a343-3d594e51afd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:53.595204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-468a1f2a-2960-4559-a343-3d594e51afd4 None None] MFA Rules not processed for user `c426cc367a1843d38978d3b8e636276e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:53.597781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-468a1f2a-2960-4559-a343-3d594e51afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:53.625269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 901/1798] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Aug 4 04:40:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:53.709096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804f93-0684-4e94-95b4-05631b8e1f37 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:53.716963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-75804f93-0684-4e94-95b4-05631b8e1f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:53.754361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804f93-0684-4e94-95b4-05631b8e1f37 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:53.780867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331299ea-e6a2-4ec4-b7e4-5a14f7e7f1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:53.781944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331299ea-e6a2-4ec4-b7e4-5a14f7e7f1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:53.782627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331299ea-e6a2-4ec4-b7e4-5a14f7e7f1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:53.782920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331299ea-e6a2-4ec4-b7e4-5a14f7e7f1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:53.805561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331299ea-e6a2-4ec4-b7e4-5a14f7e7f1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:53.809670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331299ea-e6a2-4ec4-b7e4-5a14f7e7f1a4 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:53.832360 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 898/1799] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:54.475321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1f2a-2960-4559-a343-3d594e51afd4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:54.478098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-468a1f2a-2960-4559-a343-3d594e51afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:54.518383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1f2a-2960-4559-a343-3d594e51afd4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:54.534062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:54.535648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:54.535994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:54.536294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] PATH_INFO: `/v3/users/041e7c10bedc4f8d9de0111d6aff39a1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:54.540512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041e7c10bedc4f8d9de0111d6aff39a1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:54.546047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:54.688783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041e7c10bedc4f8d9de0111d6aff39a1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:54.690298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041e7c10bedc4f8d9de0111d6aff39a1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:54.706250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041e7c10bedc4f8d9de0111d6aff39a1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:54.715354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041e7c10bedc4f8d9de0111d6aff39a1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:54.726701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041e7c10bedc4f8d9de0111d6aff39a1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:54.753659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef65de-8d04-4cd1-ba68-5666da843ef1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:54.762940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef65de-8d04-4cd1-ba68-5666da843ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:54.763559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef65de-8d04-4cd1-ba68-5666da843ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:54.766933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 902/1800] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:54 2022] DELETE /identity/v3/users/041e7c10bedc4f8d9de0111d6aff39a1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:54.805909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-deef65de-8d04-4cd1-ba68-5666da843ef1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:54.807714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-deef65de-8d04-4cd1-ba68-5666da843ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:54.947248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 899/1801] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:55.058276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:55.058276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:55.209933 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d04abd-abcb-4075-b591-aa4ba9b98729 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:55.219642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f6b2-96fe-4e86-9572-69c4a1addee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:55.220498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f6b2-96fe-4e86-9572-69c4a1addee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:55.220782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f6b2-96fe-4e86-9572-69c4a1addee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:55.221059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f6b2-96fe-4e86-9572-69c4a1addee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:55.255581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95f6b2-96fe-4e86-9572-69c4a1addee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:55.258430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95f6b2-96fe-4e86-9572-69c4a1addee4 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:55.284919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 903/1802] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:55.977991 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef65de-8d04-4cd1-ba68-5666da843ef1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:55.981343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-deef65de-8d04-4cd1-ba68-5666da843ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:56.002029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef65de-8d04-4cd1-ba68-5666da843ef1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:56.010558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:56.012469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:56.016670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:56.017186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] PATH_INFO: `/v3/projects/a208945911c04aa88ba52b31ec6e0890` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:56.020217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a208945911c04aa88ba52b31ec6e0890)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:56.024445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:56.143615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:56.156593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a208945911c04aa88ba52b31ec6e0890', 'request_id': 'req-82fefc76-8751-493d-842d-59b762befabf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.172616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a208945911c04aa88ba52b31ec6e0890', 'request_id': 'req-82fefc76-8751-493d-842d-59b762befabf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.200537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a208945911c04aa88ba52b31ec6e0890', 'request_id': 'req-82fefc76-8751-493d-842d-59b762befabf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.238724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] The token cache is being invalidate because project a208945911c04aa88ba52b31ec6e0890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:56.242899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.244301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-82fefc76-8751-493d-842d-59b762befabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.246618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 900/1803] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:55 2022] DELETE /identity/v3/projects/a208945911c04aa88ba52b31ec6e0890 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:56.251084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f6b2-96fe-4e86-9572-69c4a1addee4 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:56.272074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f6b2-96fe-4e86-9572-69c4a1addee4 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:56.482064 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:56.499168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:56.502412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:56.503254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:56.504013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] PATH_INFO: `/v3/users/3d617cfd40c0443980e1f39f5c67da3f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:56.509414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d617cfd40c0443980e1f39f5c67da3f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:56.514391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:56.650782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d617cfd40c0443980e1f39f5c67da3f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.651719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d617cfd40c0443980e1f39f5c67da3f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.668977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d617cfd40c0443980e1f39f5c67da3f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.673659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca672bb-a291-45cd-a77e-918598a12cd5 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:56.674347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca672bb-a291-45cd-a77e-918598a12cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:56.674787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca672bb-a291-45cd-a77e-918598a12cd5 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:56.677126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 901/1804] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:40:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:40:56.677241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d617cfd40c0443980e1f39f5c67da3f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.697259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d617cfd40c0443980e1f39f5c67da3f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:56.714810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 904/1805] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:56 2022] DELETE /identity/v3/users/3d617cfd40c0443980e1f39f5c67da3f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:56.751668 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20400-3378-4ccb-8160-b242d93b61f7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:56.751967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20400-3378-4ccb-8160-b242d93b61f7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:56.752249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20400-3378-4ccb-8160-b242d93b61f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:56.773557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:56.775396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:56.829197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-88b20400-3378-4ccb-8160-b242d93b61f7 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:40:56.836341 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-88b20400-3378-4ccb-8160-b242d93b61f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:57.015740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331293e6-6950-4cf0-ba13-ce27f55d47bc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:57.033914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:57.035755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:57.037906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:57.038474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] PATH_INFO: `/v3/projects/adef2ef17f154ac6a2bfa87840e1f6aa` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:57.042130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adef2ef17f154ac6a2bfa87840e1f6aa)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:57.046581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:57.083594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 902/1806] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:40:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:40:57.156855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adef2ef17f154ac6a2bfa87840e1f6aa', 'request_id': 'req-9846d9a1-8ed9-411b-8008-67b18acda5f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.177602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adef2ef17f154ac6a2bfa87840e1f6aa', 'request_id': 'req-9846d9a1-8ed9-411b-8008-67b18acda5f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.208213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adef2ef17f154ac6a2bfa87840e1f6aa', 'request_id': 'req-9846d9a1-8ed9-411b-8008-67b18acda5f0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.262522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] The token cache is being invalidate because project adef2ef17f154ac6a2bfa87840e1f6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:57.265185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.268843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.273179 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 905/1807] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:56 2022] DELETE /identity/v3/projects/adef2ef17f154ac6a2bfa87840e1f6aa => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:57.277075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20400-3378-4ccb-8160-b242d93b61f7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:57.328182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20400-3378-4ccb-8160-b242d93b61f7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:57.529730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:57.530908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:57.533055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:57.533568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] PATH_INFO: `/v3/users/bbad0920ae704270b9f58169871855ae` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:57.542413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbad0920ae704270b9f58169871855ae)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:57.544753 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:57.682877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbad0920ae704270b9f58169871855ae'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.686090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbad0920ae704270b9f58169871855ae'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.728982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbad0920ae704270b9f58169871855ae'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.741412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:57.757663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbad0920ae704270b9f58169871855ae'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.758356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbad0920ae704270b9f58169871855ae'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:57.793070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 903/1808] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:57 2022] DELETE /identity/v3/users/bbad0920ae704270b9f58169871855ae => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:40:57.853248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:57.854667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:57.860267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:58.023057 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846d9a1-8ed9-411b-8008-67b18acda5f0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:58.191766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abcf06-cfcf-4532-ae73-17ccabec9985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:58.192332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abcf06-cfcf-4532-ae73-17ccabec9985 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:58.192608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abcf06-cfcf-4532-ae73-17ccabec9985 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:58.192877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abcf06-cfcf-4532-ae73-17ccabec9985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:58.196456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21abcf06-cfcf-4532-ae73-17ccabec9985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:58.223181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abcf06-cfcf-4532-ae73-17ccabec9985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:58.227073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abcf06-cfcf-4532-ae73-17ccabec9985 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:58.262260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 906/1809] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:40:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:40:58.523246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:58.525137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:58.749100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1ec0-ae81-4ca5-95ae-f48610e57c48 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:58.762339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:58.763468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:58.765404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:58.766606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] PATH_INFO: `/v3/projects/02eb481375bf45e0ac5a909d402bca5b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:58.772746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] RBAC: Authorizing `identity:delete_project(project_id=02eb481375bf45e0ac5a909d402bca5b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:58.779047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:58.913466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02eb481375bf45e0ac5a909d402bca5b', 'request_id': 'req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:58.926494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02eb481375bf45e0ac5a909d402bca5b', 'request_id': 'req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:58.953177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02eb481375bf45e0ac5a909d402bca5b', 'request_id': 'req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:58.980752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] The token cache is being invalidate because project 02eb481375bf45e0ac5a909d402bca5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:58.981217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:58.983797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:58.986147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 904/1810] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:58 2022] DELETE /identity/v3/projects/02eb481375bf45e0ac5a909d402bca5b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:58.990812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abcf06-cfcf-4532-ae73-17ccabec9985 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:59.008310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abcf06-cfcf-4532-ae73-17ccabec9985 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:59.074676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:59.076721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:59.191388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:59.192211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:59.192705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:59.193107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] PATH_INFO: `/v3/users/1cd5b9c9adef4c9d82b7d95bd2a96873` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:59.195767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd5b9c9adef4c9d82b7d95bd2a96873)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:59.201398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:59.263395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:59.264666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f5ab1-dfa7-48c4-ac7c-202ed030eedf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:59.281726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:59.282522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:59.282660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:59.282952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] PATH_INFO: `/v3/projects/6e073fbb87974a488af8e35eac1eeb70` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:59.284193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e073fbb87974a488af8e35eac1eeb70)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:59.286143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:40:59.303857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd5b9c9adef4c9d82b7d95bd2a96873'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.306278 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd5b9c9adef4c9d82b7d95bd2a96873'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.334650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:40:59.356459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd5b9c9adef4c9d82b7d95bd2a96873'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.385199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd5b9c9adef4c9d82b7d95bd2a96873'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.407923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd5b9c9adef4c9d82b7d95bd2a96873'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.414572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e073fbb87974a488af8e35eac1eeb70', 'request_id': 'req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.419761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 907/1811] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:58 2022] DELETE /identity/v3/users/1cd5b9c9adef4c9d82b7d95bd2a96873 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:40:59.431725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e073fbb87974a488af8e35eac1eeb70', 'request_id': 'req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.466528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e073fbb87974a488af8e35eac1eeb70', 'request_id': 'req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.484015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] The token cache is being invalidate because project 6e073fbb87974a488af8e35eac1eeb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:40:59.484432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.485560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:40:59.494821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 905/1812] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:59 2022] DELETE /identity/v3/projects/6e073fbb87974a488af8e35eac1eeb70 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:40:59.499096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:59.500658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:59.723421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7de9ce-5b66-4e0e-87c6-54f64bef76bd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:40:59.734101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:40:59.735869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:40:59.748410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:40:59.749125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:40:59.749406 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:40:59.754642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] PATH_INFO: `/v3/users/c987866afd61488bb5c376f03ce8c3db` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:40:59.762494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c987866afd61488bb5c376f03ce8c3db)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:40:59.772310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:00.007623 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c987866afd61488bb5c376f03ce8c3db'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.008420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c987866afd61488bb5c376f03ce8c3db'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.015356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dd9bc-b138-4190-a1fc-7a9fbc86d9f2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:00.027330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:00.028111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:00.028380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:00.028656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] PATH_INFO: `/v3/projects/892f17db590d4e429ea8a7e185f4778f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:00.030518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=892f17db590d4e429ea8a7e185f4778f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:00.033971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:00.044819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c987866afd61488bb5c376f03ce8c3db'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.065296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c987866afd61488bb5c376f03ce8c3db'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.078803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26ad7794-1ed5-4c03-9fee-eaaa7b91f387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c987866afd61488bb5c376f03ce8c3db'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.095589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 908/1813] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:40:59 2022] DELETE /identity/v3/users/c987866afd61488bb5c376f03ce8c3db => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:00.136905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892f17db590d4e429ea8a7e185f4778f', 'request_id': 'req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.147962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892f17db590d4e429ea8a7e185f4778f', 'request_id': 'req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.166559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892f17db590d4e429ea8a7e185f4778f', 'request_id': 'req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.211839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] The token cache is being invalidate because project 892f17db590d4e429ea8a7e185f4778f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:00.212203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.214648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a98c27b3-a624-4a2d-98ca-eecc1bc7f78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:00.223040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 906/1814] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:40:59 2022] DELETE /identity/v3/projects/892f17db590d4e429ea8a7e185f4778f => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:00.226392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619211e-2efe-43bf-840e-8b65aabae266 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:00.226738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619211e-2efe-43bf-840e-8b65aabae266 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:00.227069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619211e-2efe-43bf-840e-8b65aabae266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:00.263610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8619211e-2efe-43bf-840e-8b65aabae266 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:00.264964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8619211e-2efe-43bf-840e-8b65aabae266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:00.328137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:00.468443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 909/1815] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:00.479987 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c529d-a46f-4ba5-a24f-1026ff83e6ba None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:00.480344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c529d-a46f-4ba5-a24f-1026ff83e6ba None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:00.481172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c529d-a46f-4ba5-a24f-1026ff83e6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:00.547676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-357c529d-a46f-4ba5-a24f-1026ff83e6ba None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:00.555268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-357c529d-a46f-4ba5-a24f-1026ff83e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:00.587404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 907/1816] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:00.591474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619211e-2efe-43bf-840e-8b65aabae266 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:00.616862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619211e-2efe-43bf-840e-8b65aabae266 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:00.635911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fefc41-a32e-4700-8da0-a1effc73cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:00.638032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fefc41-a32e-4700-8da0-a1effc73cf72 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:00.640014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fefc41-a32e-4700-8da0-a1effc73cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:00.640014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fefc41-a32e-4700-8da0-a1effc73cf72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:00.641700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fefc41-a32e-4700-8da0-a1effc73cf72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:00.644346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fefc41-a32e-4700-8da0-a1effc73cf72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:00.652441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fefc41-a32e-4700-8da0-a1effc73cf72 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:00.697975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 910/1817] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:00.700997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c529d-a46f-4ba5-a24f-1026ff83e6ba None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:00.719951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c529d-a46f-4ba5-a24f-1026ff83e6ba None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:00.746733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1368-7cba-401b-84ad-21eafe8c5e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:00.749905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1368-7cba-401b-84ad-21eafe8c5e6e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:00.752056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1368-7cba-401b-84ad-21eafe8c5e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:00.752355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1368-7cba-401b-84ad-21eafe8c5e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:00.753204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd1368-7cba-401b-84ad-21eafe8c5e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:00.761363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd1368-7cba-401b-84ad-21eafe8c5e6e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:00.883900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 908/1818] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:00 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:00.888026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fefc41-a32e-4700-8da0-a1effc73cf72 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:00.904911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fefc41-a32e-4700-8da0-a1effc73cf72 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:01.058353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc45ceb-caf8-4511-abc4-12903e76149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:01.060451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45ceb-caf8-4511-abc4-12903e76149a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:01.063986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45ceb-caf8-4511-abc4-12903e76149a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:01.064294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45ceb-caf8-4511-abc4-12903e76149a admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:01.066695 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc45ceb-caf8-4511-abc4-12903e76149a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:01.075879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc45ceb-caf8-4511-abc4-12903e76149a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:01.134614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 911/1819] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:00 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:01.139613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1368-7cba-401b-84ad-21eafe8c5e6e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:01.168344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1368-7cba-401b-84ad-21eafe8c5e6e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:01.192387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75caa0-3694-4a11-8f4d-a728ab09f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:01.193880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75caa0-3694-4a11-8f4d-a728ab09f07d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:01.195342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75caa0-3694-4a11-8f4d-a728ab09f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:01.196323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75caa0-3694-4a11-8f4d-a728ab09f07d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:01.197202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75caa0-3694-4a11-8f4d-a728ab09f07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:01.203687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75caa0-3694-4a11-8f4d-a728ab09f07d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:01.207761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:01.236116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 909/1820] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:01.242606 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc45ceb-caf8-4511-abc4-12903e76149a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:01.261982 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc45ceb-caf8-4511-abc4-12903e76149a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:01.265123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8de4ba-1d4e-461a-bf0f-a1ae0793fc78 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:01.265483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8de4ba-1d4e-461a-bf0f-a1ae0793fc78 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:01.265767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8de4ba-1d4e-461a-bf0f-a1ae0793fc78 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:01.267487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 910/1821] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 04:41:01.288988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1acdc4-1caa-455e-a8a2-3bea70d5000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:01.288988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1acdc4-1caa-455e-a8a2-3bea70d5000f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:01.288988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1acdc4-1caa-455e-a8a2-3bea70d5000f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:01.288988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1acdc4-1caa-455e-a8a2-3bea70d5000f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:01.289784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1acdc4-1caa-455e-a8a2-3bea70d5000f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:01.289784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1acdc4-1caa-455e-a8a2-3bea70d5000f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:01.311940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8de4ba-1d4e-461a-bf0f-a1ae0793fc78 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:01.316180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 912/1822] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:01.333580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8de4ba-1d4e-461a-bf0f-a1ae0793fc78 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:01.357842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136ef04-fdf2-427e-91ee-1e8f5b9652e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:01.358603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ef04-fdf2-427e-91ee-1e8f5b9652e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:01.360231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ef04-fdf2-427e-91ee-1e8f5b9652e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:01.360523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ef04-fdf2-427e-91ee-1e8f5b9652e8 admin admin] PATH_INFO: `/v3/projects/f14d7bb2b3ad4167aca5ad3c00628c97/users/c43920b4fe4c4b138ab18c310d6b2ae0/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:01.422746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136ef04-fdf2-427e-91ee-1e8f5b9652e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14d7bb2b3ad4167aca5ad3c00628c97, user_id=c43920b4fe4c4b138ab18c310d6b2ae0, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:01.430807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136ef04-fdf2-427e-91ee-1e8f5b9652e8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:01.469489 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 911/1823] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:01 2022] PUT /identity/v3/projects/f14d7bb2b3ad4167aca5ad3c00628c97/users/c43920b4fe4c4b138ab18c310d6b2ae0/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:01.485952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b94b1-40c5-4ba3-801e-72dd8a8d4f09 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:01.486289 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b94b1-40c5-4ba3-801e-72dd8a8d4f09 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:01.486549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b94b1-40c5-4ba3-801e-72dd8a8d4f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:01.552595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9d1b94b1-40c5-4ba3-801e-72dd8a8d4f09 None None] MFA Rules not processed for user `c43920b4fe4c4b138ab18c310d6b2ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:01.562018 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9d1b94b1-40c5-4ba3-801e-72dd8a8d4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:01.629798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb1d6d-15cf-449f-ba16-bcbcd7f8f14a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:01.630239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb1d6d-15cf-449f-ba16-bcbcd7f8f14a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:01.630620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb1d6d-15cf-449f-ba16-bcbcd7f8f14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:01.680237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-40bb1d6d-15cf-449f-ba16-bcbcd7f8f14a None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:01.681743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-40bb1d6d-15cf-449f-ba16-bcbcd7f8f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:01.793949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 912/1824] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:41:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:01.838670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 913/1825] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:01.843834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb1d6d-15cf-449f-ba16-bcbcd7f8f14a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:01.962730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb1d6d-15cf-449f-ba16-bcbcd7f8f14a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:01.968566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776402-3a2c-4ada-96b1-6a3af36a1aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:01.969602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776402-3a2c-4ada-96b1-6a3af36a1aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:01.969916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776402-3a2c-4ada-96b1-6a3af36a1aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:01.970405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776402-3a2c-4ada-96b1-6a3af36a1aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:01.971352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776402-3a2c-4ada-96b1-6a3af36a1aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:01.973487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776402-3a2c-4ada-96b1-6a3af36a1aa2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:02.022003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 913/1826] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:01 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:02.022579 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b94b1-40c5-4ba3-801e-72dd8a8d4f09 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:02.049085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b94b1-40c5-4ba3-801e-72dd8a8d4f09 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:02.088608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:02.214244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6de46-0e1b-4986-9821-d94387150a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:02.216800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6de46-0e1b-4986-9821-d94387150a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:02.217325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6de46-0e1b-4986-9821-d94387150a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:02.217869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6de46-0e1b-4986-9821-d94387150a22 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:02.219598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6de46-0e1b-4986-9821-d94387150a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:02.222037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6de46-0e1b-4986-9821-d94387150a22 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:02.282372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 914/1827] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:02 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:02.297004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776402-3a2c-4ada-96b1-6a3af36a1aa2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:02.325887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776402-3a2c-4ada-96b1-6a3af36a1aa2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:02.332899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ccbc8-bf6d-4fee-9c9d-c052952783ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:02.333772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ccbc8-bf6d-4fee-9c9d-c052952783ad admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:02.334280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ccbc8-bf6d-4fee-9c9d-c052952783ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:02.334811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ccbc8-bf6d-4fee-9c9d-c052952783ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:02.336555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ccbc8-bf6d-4fee-9c9d-c052952783ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:02.345068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ccbc8-bf6d-4fee-9c9d-c052952783ad admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:02.363873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6de46-0e1b-4986-9821-d94387150a22 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:02.367340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 914/1828] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:02.398016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6de46-0e1b-4986-9821-d94387150a22 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:02.417072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafefc23-e681-4ec4-a0f5-f2d5eed3226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:02.417768 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafefc23-e681-4ec4-a0f5-f2d5eed3226d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:02.432483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafefc23-e681-4ec4-a0f5-f2d5eed3226d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:02.435570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafefc23-e681-4ec4-a0f5-f2d5eed3226d admin admin] PATH_INFO: `/v3/projects/0c52f6d9e27e4c0e80744c056fcae6e1/users/119ea75588764a2e871f233d07343a15/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:02.483838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafefc23-e681-4ec4-a0f5-f2d5eed3226d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c52f6d9e27e4c0e80744c056fcae6e1, user_id=119ea75588764a2e871f233d07343a15, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:02.487978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafefc23-e681-4ec4-a0f5-f2d5eed3226d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:02.518382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 915/1829] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:02 2022] PUT /identity/v3/projects/0c52f6d9e27e4c0e80744c056fcae6e1/users/119ea75588764a2e871f233d07343a15/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:02.519787 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafefc23-e681-4ec4-a0f5-f2d5eed3226d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:02.520719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ccbc8-bf6d-4fee-9c9d-c052952783ad admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:02.523328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-060ccbc8-bf6d-4fee-9c9d-c052952783ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:02.621531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:02.665423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafefc23-e681-4ec4-a0f5-f2d5eed3226d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:02.673131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0436f17-55bb-48d4-819f-feb85c78fe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:02.674732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0436f17-55bb-48d4-819f-feb85c78fe27 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:02.675616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0436f17-55bb-48d4-819f-feb85c78fe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:02.675616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0436f17-55bb-48d4-819f-feb85c78fe27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:02.676260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0436f17-55bb-48d4-819f-feb85c78fe27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:02.678423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0436f17-55bb-48d4-819f-feb85c78fe27 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:02.699061 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 916/1830] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:02.710502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0436f17-55bb-48d4-819f-feb85c78fe27 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:02.717989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ccbc8-bf6d-4fee-9c9d-c052952783ad admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:02.723725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0436f17-55bb-48d4-819f-feb85c78fe27 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:02.729449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932c7dd-818e-4ca4-90e4-4377a9437d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:02.731498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932c7dd-818e-4ca4-90e4-4377a9437d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:02.731963 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932c7dd-818e-4ca4-90e4-4377a9437d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:02.732428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932c7dd-818e-4ca4-90e4-4377a9437d2e admin admin] PATH_INFO: `/v3/projects/0c52f6d9e27e4c0e80744c056fcae6e1/users/119ea75588764a2e871f233d07343a15/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:02.734657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932c7dd-818e-4ca4-90e4-4377a9437d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c52f6d9e27e4c0e80744c056fcae6e1, user_id=119ea75588764a2e871f233d07343a15, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:02.738000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932c7dd-818e-4ca4-90e4-4377a9437d2e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:02.759518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 917/1831] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:02 2022] PUT /identity/v3/projects/0c52f6d9e27e4c0e80744c056fcae6e1/users/119ea75588764a2e871f233d07343a15/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:02.779515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa70ce4-7475-4c9e-a18e-3e387612aa34 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:02.779880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa70ce4-7475-4c9e-a18e-3e387612aa34 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:02.780142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa70ce4-7475-4c9e-a18e-3e387612aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:02.869785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5fa70ce4-7475-4c9e-a18e-3e387612aa34 None None] MFA Rules not processed for user `119ea75588764a2e871f233d07343a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:02.878859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5fa70ce4-7475-4c9e-a18e-3e387612aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:02.958545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709a38b-9eb6-4fd2-a0d4-3a0e97f0b8c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:02.960683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709a38b-9eb6-4fd2-a0d4-3a0e97f0b8c1 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:02.960964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709a38b-9eb6-4fd2-a0d4-3a0e97f0b8c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:02.963942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709a38b-9eb6-4fd2-a0d4-3a0e97f0b8c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:02.994359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709a38b-9eb6-4fd2-a0d4-3a0e97f0b8c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:02.997212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709a38b-9eb6-4fd2-a0d4-3a0e97f0b8c1 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:03.012608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 915/1832] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:03.142313 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:03.226764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 918/1833] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:03.246944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709a38b-9eb6-4fd2-a0d4-3a0e97f0b8c1 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:03.249364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7709a38b-9eb6-4fd2-a0d4-3a0e97f0b8c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:03.283574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa70ce4-7475-4c9e-a18e-3e387612aa34 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:03.285744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5fa70ce4-7475-4c9e-a18e-3e387612aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:03.374917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709a38b-9eb6-4fd2-a0d4-3a0e97f0b8c1 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:03.531404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa70ce4-7475-4c9e-a18e-3e387612aa34 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:03.572447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:03.573864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:03.574390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:03.575891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] PATH_INFO: `/v3/projects/31e05e566c0a46c1a590b198fab93e06` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:03.582772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e05e566c0a46c1a590b198fab93e06)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:03.586846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:03.685965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47714880-57ac-4bbf-9ce8-4e3ff6eec9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:03.688170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714880-57ac-4bbf-9ce8-4e3ff6eec9bc service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:03.688286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714880-57ac-4bbf-9ce8-4e3ff6eec9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:03.688535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47714880-57ac-4bbf-9ce8-4e3ff6eec9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:03.738851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e05e566c0a46c1a590b198fab93e06', 'request_id': 'req-f75e297a-7ff5-4f3c-a202-0936f0607394'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:03.747676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e05e566c0a46c1a590b198fab93e06', 'request_id': 'req-f75e297a-7ff5-4f3c-a202-0936f0607394'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:03.763127 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e05e566c0a46c1a590b198fab93e06', 'request_id': 'req-f75e297a-7ff5-4f3c-a202-0936f0607394'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:03.783992 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] The token cache is being invalidate because project 31e05e566c0a46c1a590b198fab93e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:03.784279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:03.784675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:03.785826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:03.796425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 919/1834] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:03 2022] DELETE /identity/v3/projects/31e05e566c0a46c1a590b198fab93e06 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:03.797580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:03.807529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:03.861867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47714880-57ac-4bbf-9ce8-4e3ff6eec9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:03.864025 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47714880-57ac-4bbf-9ce8-4e3ff6eec9bc service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:03.885962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 916/1835] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:03.887531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ab70-f512-4d37-a924-f11a392ea773 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:03.887808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ab70-f512-4d37-a924-f11a392ea773 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:03.888124 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ab70-f512-4d37-a924-f11a392ea773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:03.944691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c158ab70-f512-4d37-a924-f11a392ea773 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:03.946016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c158ab70-f512-4d37-a924-f11a392ea773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:03.998161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 917/1836] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:04.007415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f9f2e-0db8-4636-aa1f-c9fbaca60e52 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.007845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f9f2e-0db8-4636-aa1f-c9fbaca60e52 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.008267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f9f2e-0db8-4636-aa1f-c9fbaca60e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.013335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e297a-7ff5-4f3c-a202-0936f0607394 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.043793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.044610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.044912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.045192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] PATH_INFO: `/v3/projects/3155882f21d8445fa60477583661e0b8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.048482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3155882f21d8445fa60477583661e0b8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.065270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bc0f9f2e-0db8-4636-aa1f-c9fbaca60e52 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:04.066654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bc0f9f2e-0db8-4636-aa1f-c9fbaca60e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:04.067738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.088201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 918/1837] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:04.092770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f9f2e-0db8-4636-aa1f-c9fbaca60e52 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.141082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f9f2e-0db8-4636-aa1f-c9fbaca60e52 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.156829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdd1bc-ed1a-4d4f-9d54-bffeb0400260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.157851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdd1bc-ed1a-4d4f-9d54-bffeb0400260 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.158336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdd1bc-ed1a-4d4f-9d54-bffeb0400260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.158810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdd1bc-ed1a-4d4f-9d54-bffeb0400260 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.159866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdd1bc-ed1a-4d4f-9d54-bffeb0400260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:04.161361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdd1bc-ed1a-4d4f-9d54-bffeb0400260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.167949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdd1bc-ed1a-4d4f-9d54-bffeb0400260 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.177690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:04.182561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 919/1838] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:41:04.186572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdd1bc-ed1a-4d4f-9d54-bffeb0400260 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.201036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdd1bc-ed1a-4d4f-9d54-bffeb0400260 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.237379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3155882f21d8445fa60477583661e0b8', 'request_id': 'req-1b531001-896e-41b7-83f1-05d51cd07031'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:04.250424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3155882f21d8445fa60477583661e0b8', 'request_id': 'req-1b531001-896e-41b7-83f1-05d51cd07031'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:04.276404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3155882f21d8445fa60477583661e0b8', 'request_id': 'req-1b531001-896e-41b7-83f1-05d51cd07031'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:04.297118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9d91-fe7c-4bf5-bbbc-b9ebd3fce13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.297789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9d91-fe7c-4bf5-bbbc-b9ebd3fce13e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.298076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9d91-fe7c-4bf5-bbbc-b9ebd3fce13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.298345 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9d91-fe7c-4bf5-bbbc-b9ebd3fce13e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.299080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9d91-fe7c-4bf5-bbbc-b9ebd3fce13e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.301339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9d91-fe7c-4bf5-bbbc-b9ebd3fce13e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.302222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] The token cache is being invalidate because project 3155882f21d8445fa60477583661e0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:04.303124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:04.304003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b531001-896e-41b7-83f1-05d51cd07031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:04.310108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 920/1839] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:03 2022] DELETE /identity/v3/projects/3155882f21d8445fa60477583661e0b8 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:04.311916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddb219-b32a-4a0f-9121-612a09677276 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.312423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddb219-b32a-4a0f-9121-612a09677276 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.313503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddb219-b32a-4a0f-9121-612a09677276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.341596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f2ddb219-b32a-4a0f-9121-612a09677276 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:04.343529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f2ddb219-b32a-4a0f-9121-612a09677276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:04.357710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 920/1840] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:04 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:04.366017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9d91-fe7c-4bf5-bbbc-b9ebd3fce13e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.366017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-462d9d91-fe7c-4bf5-bbbc-b9ebd3fce13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:04.367689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 921/1841] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:04.369740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaaef8-c986-40a3-80cc-baa1d79b63fa None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.370255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaaef8-c986-40a3-80cc-baa1d79b63fa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.370808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaaef8-c986-40a3-80cc-baa1d79b63fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.413591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-afcaaef8-c986-40a3-80cc-baa1d79b63fa None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:04.415323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-afcaaef8-c986-40a3-80cc-baa1d79b63fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:04.495321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9d91-fe7c-4bf5-bbbc-b9ebd3fce13e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.501176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76b771-3c97-4fa6-95dd-4c0223fed4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.501848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76b771-3c97-4fa6-95dd-4c0223fed4bb admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.502134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76b771-3c97-4fa6-95dd-4c0223fed4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.502410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76b771-3c97-4fa6-95dd-4c0223fed4bb admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.503109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76b771-3c97-4fa6-95dd-4c0223fed4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.505265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76b771-3c97-4fa6-95dd-4c0223fed4bb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.536593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 921/1842] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:04 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:04.540081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76b771-3c97-4fa6-95dd-4c0223fed4bb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.557536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76b771-3c97-4fa6-95dd-4c0223fed4bb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.571184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 922/1843] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:04.571961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d13cb5-e972-452e-9d82-6f4f37f091d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.572614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d13cb5-e972-452e-9d82-6f4f37f091d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.572896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d13cb5-e972-452e-9d82-6f4f37f091d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.573172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d13cb5-e972-452e-9d82-6f4f37f091d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.573889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d13cb5-e972-452e-9d82-6f4f37f091d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.575425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaaef8-c986-40a3-80cc-baa1d79b63fa None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.575795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d13cb5-e972-452e-9d82-6f4f37f091d6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.595460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaaef8-c986-40a3-80cc-baa1d79b63fa None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.609667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bb1a7-9b49-4893-afd3-9161a530e48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.610599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb1a7-9b49-4893-afd3-9161a530e48b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.611606 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb1a7-9b49-4893-afd3-9161a530e48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.612583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb1a7-9b49-4893-afd3-9161a530e48b admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.615969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 922/1844] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:04.616894 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bb1a7-9b49-4893-afd3-9161a530e48b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:04.617357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bb1a7-9b49-4893-afd3-9161a530e48b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.619095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d13cb5-e972-452e-9d82-6f4f37f091d6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.621095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bb1a7-9b49-4893-afd3-9161a530e48b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.657633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 923/1845] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:41:04.658526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bb1a7-9b49-4893-afd3-9161a530e48b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.658859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d13cb5-e972-452e-9d82-6f4f37f091d6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.674430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830e500-6754-489e-aee4-8664c28199ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.675131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830e500-6754-489e-aee4-8664c28199ba admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.675515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830e500-6754-489e-aee4-8664c28199ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.675891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830e500-6754-489e-aee4-8664c28199ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.677186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830e500-6754-489e-aee4-8664c28199ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.681612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830e500-6754-489e-aee4-8664c28199ba admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.682900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bb1a7-9b49-4893-afd3-9161a530e48b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.689613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:04.700998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e08f0d-36b3-4861-b26a-222366e17300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.701633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08f0d-36b3-4861-b26a-222366e17300 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.701907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08f0d-36b3-4861-b26a-222366e17300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.702826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08f0d-36b3-4861-b26a-222366e17300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.703120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e08f0d-36b3-4861-b26a-222366e17300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.708475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e08f0d-36b3-4861-b26a-222366e17300 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.713130 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 923/1846] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:04.716688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830e500-6754-489e-aee4-8664c28199ba admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.744510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830e500-6754-489e-aee4-8664c28199ba admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.754447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071146aa-8851-4088-b464-d0f1b4c18b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.755254 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071146aa-8851-4088-b464-d0f1b4c18b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.756211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071146aa-8851-4088-b464-d0f1b4c18b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.756503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071146aa-8851-4088-b464-d0f1b4c18b15 admin admin] PATH_INFO: `/v3/projects/4c0a977685e04f3dbca8305443d5c16e/users/5f4d9dbd42bb408db3e463a4c9bbd170/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.780576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071146aa-8851-4088-b464-d0f1b4c18b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0a977685e04f3dbca8305443d5c16e, user_id=5f4d9dbd42bb408db3e463a4c9bbd170, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.783804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071146aa-8851-4088-b464-d0f1b4c18b15 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.804537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 924/1847] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:04 2022] POST /identity/v3/projects => generated 401 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:04.804697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 924/1848] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:04 2022] PUT /identity/v3/projects/4c0a977685e04f3dbca8305443d5c16e/users/5f4d9dbd42bb408db3e463a4c9bbd170/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:04.809048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e08f0d-36b3-4861-b26a-222366e17300 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.815191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5eb9f-dee2-4781-aa60-a2d06c0928e1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.815690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5eb9f-dee2-4781-aa60-a2d06c0928e1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.816436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5eb9f-dee2-4781-aa60-a2d06c0928e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.855834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-65b5eb9f-dee2-4781-aa60-a2d06c0928e1 None None] MFA Rules not processed for user `5f4d9dbd42bb408db3e463a4c9bbd170`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:04.857767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-65b5eb9f-dee2-4781-aa60-a2d06c0928e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:04.922548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e08f0d-36b3-4861-b26a-222366e17300 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.935810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8987e8-7b3e-4b92-aa76-04feb0612027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.935810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8987e8-7b3e-4b92-aa76-04feb0612027 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.935810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8987e8-7b3e-4b92-aa76-04feb0612027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.935810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8987e8-7b3e-4b92-aa76-04feb0612027 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.936147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8987e8-7b3e-4b92-aa76-04feb0612027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.936147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8987e8-7b3e-4b92-aa76-04feb0612027 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.945869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 925/1849] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:04.951501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5eb9f-dee2-4781-aa60-a2d06c0928e1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.968250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5eb9f-dee2-4781-aa60-a2d06c0928e1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:04.971044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 925/1850] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:04 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:04.974823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce528e-8915-4c42-8f77-499ae780e674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:04.975470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce528e-8915-4c42-8f77-499ae780e674 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:04.976486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8987e8-7b3e-4b92-aa76-04feb0612027 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:04.978626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce528e-8915-4c42-8f77-499ae780e674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:04.978626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce528e-8915-4c42-8f77-499ae780e674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:04.979381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce528e-8915-4c42-8f77-499ae780e674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:04.982674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce528e-8915-4c42-8f77-499ae780e674 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:04.985679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:05.009161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8987e8-7b3e-4b92-aa76-04feb0612027 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.023618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17499f-6e79-429f-8a36-9005331c78fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.024855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17499f-6e79-429f-8a36-9005331c78fb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.025148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17499f-6e79-429f-8a36-9005331c78fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.025428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17499f-6e79-429f-8a36-9005331c78fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.026340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 926/1851] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:04 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:05.026952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17499f-6e79-429f-8a36-9005331c78fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.028930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17499f-6e79-429f-8a36-9005331c78fb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.032641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce528e-8915-4c42-8f77-499ae780e674 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.043780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 926/1852] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:05.047850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17499f-6e79-429f-8a36-9005331c78fb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.058724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17499f-6e79-429f-8a36-9005331c78fb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.137836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce528e-8915-4c42-8f77-499ae780e674 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.141008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3cfdf-9aa5-45f1-b401-5ddd93671f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.141839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3cfdf-9aa5-45f1-b401-5ddd93671f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.142335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3cfdf-9aa5-45f1-b401-5ddd93671f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.143065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525eb7-e616-4846-9bc5-31dde8d62b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.143220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3cfdf-9aa5-45f1-b401-5ddd93671f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.143536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525eb7-e616-4846-9bc5-31dde8d62b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.143950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3cfdf-9aa5-45f1-b401-5ddd93671f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.144055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525eb7-e616-4846-9bc5-31dde8d62b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.144218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525eb7-e616-4846-9bc5-31dde8d62b29 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.144880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525eb7-e616-4846-9bc5-31dde8d62b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.145964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3cfdf-9aa5-45f1-b401-5ddd93671f2a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.146876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525eb7-e616-4846-9bc5-31dde8d62b29 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.159615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 927/1853] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:05.163566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3cfdf-9aa5-45f1-b401-5ddd93671f2a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.175954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3cfdf-9aa5-45f1-b401-5ddd93671f2a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.179042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 927/1854] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:05 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:05.184019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525eb7-e616-4846-9bc5-31dde8d62b29 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.184864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03637d64-31a9-4ce1-9e51-748c46d4edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.185703 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03637d64-31a9-4ce1-9e51-748c46d4edd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.185986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03637d64-31a9-4ce1-9e51-748c46d4edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.186386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03637d64-31a9-4ce1-9e51-748c46d4edd0 admin admin] PATH_INFO: `/v3/projects/d979ff54407b471883898e359ce52609/users/a2c5a5a98a8d4ad49ea0f23dcd4d787b/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.196986 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525eb7-e616-4846-9bc5-31dde8d62b29 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.201919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f455c7-33d4-4100-8f70-f271272304fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.202539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f455c7-33d4-4100-8f70-f271272304fb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.202812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f455c7-33d4-4100-8f70-f271272304fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.203125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f455c7-33d4-4100-8f70-f271272304fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.203815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f455c7-33d4-4100-8f70-f271272304fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.205447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f455c7-33d4-4100-8f70-f271272304fb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.206682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03637d64-31a9-4ce1-9e51-748c46d4edd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d979ff54407b471883898e359ce52609, user_id=a2c5a5a98a8d4ad49ea0f23dcd4d787b, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.210281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03637d64-31a9-4ce1-9e51-748c46d4edd0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.216296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 928/1855] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:05.221123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f455c7-33d4-4100-8f70-f271272304fb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.234566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f455c7-33d4-4100-8f70-f271272304fb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.241610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 928/1856] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:05 2022] PUT /identity/v3/projects/d979ff54407b471883898e359ce52609/users/a2c5a5a98a8d4ad49ea0f23dcd4d787b/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:05.247418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ff37-d775-43c2-93dc-7d56178bfd7a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.247990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ff37-d775-43c2-93dc-7d56178bfd7a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.248369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ff37-d775-43c2-93dc-7d56178bfd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.267175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:05.285392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1743ff37-d775-43c2-93dc-7d56178bfd7a None None] MFA Rules not processed for user `a2c5a5a98a8d4ad49ea0f23dcd4d787b`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:05.287397 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1743ff37-d775-43c2-93dc-7d56178bfd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:05.347711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec029ba-d9e0-4570-82d8-1ca52d360317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.348802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec029ba-d9e0-4570-82d8-1ca52d360317 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.349316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec029ba-d9e0-4570-82d8-1ca52d360317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.349812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec029ba-d9e0-4570-82d8-1ca52d360317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.351204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec029ba-d9e0-4570-82d8-1ca52d360317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.353751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec029ba-d9e0-4570-82d8-1ca52d360317 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.368005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 929/1857] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:05.377596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec029ba-d9e0-4570-82d8-1ca52d360317 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.389365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec029ba-d9e0-4570-82d8-1ca52d360317 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.395735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d37ebc-8a19-43e3-bfe4-8af64ffcb377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.397525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d37ebc-8a19-43e3-bfe4-8af64ffcb377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.397887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d37ebc-8a19-43e3-bfe4-8af64ffcb377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.398226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d37ebc-8a19-43e3-bfe4-8af64ffcb377 admin admin] PATH_INFO: `/v3/projects/7f1aa4b393894a3d8b6d8e558283dbff/users/705d133af0664981bb7267a3cb68e436/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.407660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 929/1858] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:05 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:05.409631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743ff37-d775-43c2-93dc-7d56178bfd7a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.417747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d37ebc-8a19-43e3-bfe4-8af64ffcb377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1aa4b393894a3d8b6d8e558283dbff, user_id=705d133af0664981bb7267a3cb68e436, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.420514 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d37ebc-8a19-43e3-bfe4-8af64ffcb377 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.421524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743ff37-d775-43c2-93dc-7d56178bfd7a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.430240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791f0fb-cce9-4a87-bbd7-ae6bf0f1c55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.430885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791f0fb-cce9-4a87-bbd7-ae6bf0f1c55c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.431241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791f0fb-cce9-4a87-bbd7-ae6bf0f1c55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.431634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791f0fb-cce9-4a87-bbd7-ae6bf0f1c55c admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.432247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791f0fb-cce9-4a87-bbd7-ae6bf0f1c55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.441372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 930/1859] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:05 2022] PUT /identity/v3/projects/7f1aa4b393894a3d8b6d8e558283dbff/users/705d133af0664981bb7267a3cb68e436/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:05.447379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791f0fb-cce9-4a87-bbd7-ae6bf0f1c55c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.451888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01182f87-2dc8-46b9-8789-80aadbe2b351 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.452175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01182f87-2dc8-46b9-8789-80aadbe2b351 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.452450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01182f87-2dc8-46b9-8789-80aadbe2b351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.480049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 930/1860] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:05 2022] POST /identity/v3/projects => generated 399 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:05.484668 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-01182f87-2dc8-46b9-8789-80aadbe2b351 None None] MFA Rules not processed for user `705d133af0664981bb7267a3cb68e436`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:05.485939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-01182f87-2dc8-46b9-8789-80aadbe2b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:05.486576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791f0fb-cce9-4a87-bbd7-ae6bf0f1c55c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.525698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:05.562860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791f0fb-cce9-4a87-bbd7-ae6bf0f1c55c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.570817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef5ebd-19b2-4429-a13b-3b1db449a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.571638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef5ebd-19b2-4429-a13b-3b1db449a7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.571959 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef5ebd-19b2-4429-a13b-3b1db449a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.572280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef5ebd-19b2-4429-a13b-3b1db449a7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.573295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef5ebd-19b2-4429-a13b-3b1db449a7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.576311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef5ebd-19b2-4429-a13b-3b1db449a7aa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.582297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 931/1861] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:05.591942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01182f87-2dc8-46b9-8789-80aadbe2b351 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.603025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 931/1862] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:05 2022] POST /identity/v3/users => generated 306 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:05.607985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef5ebd-19b2-4429-a13b-3b1db449a7aa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.612113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01182f87-2dc8-46b9-8789-80aadbe2b351 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.617938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aaef6-3eeb-4043-875a-a9cb6e6f583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.618610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aaef6-3eeb-4043-875a-a9cb6e6f583b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.618888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aaef6-3eeb-4043-875a-a9cb6e6f583b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.619208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0aaef6-3eeb-4043-875a-a9cb6e6f583b admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.619869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0aaef6-3eeb-4043-875a-a9cb6e6f583b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.621858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0aaef6-3eeb-4043-875a-a9cb6e6f583b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.622410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef5ebd-19b2-4429-a13b-3b1db449a7aa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.628145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9f6ec-de67-45fb-b6eb-9fb7105b4418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.629067 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9f6ec-de67-45fb-b6eb-9fb7105b4418 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.629553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9f6ec-de67-45fb-b6eb-9fb7105b4418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.630030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9f6ec-de67-45fb-b6eb-9fb7105b4418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.631629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9f6ec-de67-45fb-b6eb-9fb7105b4418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.633658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9f6ec-de67-45fb-b6eb-9fb7105b4418 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.646122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 932/1863] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:05.650243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9f6ec-de67-45fb-b6eb-9fb7105b4418 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.664206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 932/1864] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:05 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:05.664422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9f6ec-de67-45fb-b6eb-9fb7105b4418 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.666714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aaef6-3eeb-4043-875a-a9cb6e6f583b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.762723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972f868-6a90-472a-a015-736d4201bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.763586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972f868-6a90-472a-a015-736d4201bc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.763876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972f868-6a90-472a-a015-736d4201bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.764152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972f868-6a90-472a-a015-736d4201bc32 admin admin] PATH_INFO: `/v3/projects/064ddce943fa483b9d6a04f47eab963c/users/2369c5fd0a98463aa9c3f1f6d0fb571a/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.765970 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0aaef6-3eeb-4043-875a-a9cb6e6f583b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.771962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cc632-5754-43b0-83bb-efa3003b392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.772694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cc632-5754-43b0-83bb-efa3003b392a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.773090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cc632-5754-43b0-83bb-efa3003b392a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.773451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cc632-5754-43b0-83bb-efa3003b392a admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.774028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cc632-5754-43b0-83bb-efa3003b392a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.776170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cc632-5754-43b0-83bb-efa3003b392a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.781834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972f868-6a90-472a-a015-736d4201bc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064ddce943fa483b9d6a04f47eab963c, user_id=2369c5fd0a98463aa9c3f1f6d0fb571a, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.784777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972f868-6a90-472a-a015-736d4201bc32 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.784998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:05.804553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 933/1866] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:05 2022] PUT /identity/v3/projects/064ddce943fa483b9d6a04f47eab963c/users/2369c5fd0a98463aa9c3f1f6d0fb571a/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:05.804771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 933/1866] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:05 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:05.808141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972f868-6a90-472a-a015-736d4201bc32 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.811041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cc632-5754-43b0-83bb-efa3003b392a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.823008 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cc632-5754-43b0-83bb-efa3003b392a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.890178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0802d-f8b0-4d1f-86b7-e308757f38bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.890768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0802d-f8b0-4d1f-86b7-e308757f38bf admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.891161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0802d-f8b0-4d1f-86b7-e308757f38bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.891705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0802d-f8b0-4d1f-86b7-e308757f38bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.892371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0802d-f8b0-4d1f-86b7-e308757f38bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.894231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0802d-f8b0-4d1f-86b7-e308757f38bf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.907679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972f868-6a90-472a-a015-736d4201bc32 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.908166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 934/1867] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:05.912163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0802d-f8b0-4d1f-86b7-e308757f38bf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.913374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284174a-5df2-4f94-a5ab-c7bc31576f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.913987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284174a-5df2-4f94-a5ab-c7bc31576f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.914257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284174a-5df2-4f94-a5ab-c7bc31576f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.914527 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284174a-5df2-4f94-a5ab-c7bc31576f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.915415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284174a-5df2-4f94-a5ab-c7bc31576f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.917303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284174a-5df2-4f94-a5ab-c7bc31576f56 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.924747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0802d-f8b0-4d1f-86b7-e308757f38bf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.930694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5885c6-f51b-48fa-8340-81201ce0673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.931536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5885c6-f51b-48fa-8340-81201ce0673e admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.931889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5885c6-f51b-48fa-8340-81201ce0673e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.932233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5885c6-f51b-48fa-8340-81201ce0673e admin admin] PATH_INFO: `/v3/projects/4b9d72670cb3454ca3e3ff26f52921a8/users/8bd581bd0d7b4a9fa93543b460ccfdc7/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.935251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 934/1868] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:05.939737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284174a-5df2-4f94-a5ab-c7bc31576f56 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.960647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284174a-5df2-4f94-a5ab-c7bc31576f56 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:05.966522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5885c6-f51b-48fa-8340-81201ce0673e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9d72670cb3454ca3e3ff26f52921a8, user_id=8bd581bd0d7b4a9fa93543b460ccfdc7, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.969419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5885c6-f51b-48fa-8340-81201ce0673e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.970852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae257ae-212a-4216-a1ea-ecea9e9df187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:05.972081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae257ae-212a-4216-a1ea-ecea9e9df187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:05.972599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae257ae-212a-4216-a1ea-ecea9e9df187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:05.973132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae257ae-212a-4216-a1ea-ecea9e9df187 admin admin] PATH_INFO: `/v3/projects/064ddce943fa483b9d6a04f47eab963c/users/2369c5fd0a98463aa9c3f1f6d0fb571a/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:05.977308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae257ae-212a-4216-a1ea-ecea9e9df187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064ddce943fa483b9d6a04f47eab963c, user_id=2369c5fd0a98463aa9c3f1f6d0fb571a, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:05.980596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae257ae-212a-4216-a1ea-ecea9e9df187 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:05.987892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 935/1869] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:05 2022] PUT /identity/v3/projects/4b9d72670cb3454ca3e3ff26f52921a8/users/8bd581bd0d7b4a9fa93543b460ccfdc7/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:05.991675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5885c6-f51b-48fa-8340-81201ce0673e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:05.997700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 935/1870] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:05 2022] PUT /identity/v3/projects/064ddce943fa483b9d6a04f47eab963c/users/2369c5fd0a98463aa9c3f1f6d0fb571a/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:06.015093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df18822-c6c5-4a86-bdaf-9f8127468bfc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:06.015974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df18822-c6c5-4a86-bdaf-9f8127468bfc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:06.016332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df18822-c6c5-4a86-bdaf-9f8127468bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:06.048706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2df18822-c6c5-4a86-bdaf-9f8127468bfc None None] MFA Rules not processed for user `2369c5fd0a98463aa9c3f1f6d0fb571a`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:06.049975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2df18822-c6c5-4a86-bdaf-9f8127468bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:06.055828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:06.066908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5885c6-f51b-48fa-8340-81201ce0673e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:06.134329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 936/1871] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:06 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:06.153028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df18822-c6c5-4a86-bdaf-9f8127468bfc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:06.154554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2df18822-c6c5-4a86-bdaf-9f8127468bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:06.159604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2246b-b8f6-4a07-8d31-29620909c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:06.160420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2246b-b8f6-4a07-8d31-29620909c7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:06.160704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2246b-b8f6-4a07-8d31-29620909c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:06.160975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2246b-b8f6-4a07-8d31-29620909c7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:06.161738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2246b-b8f6-4a07-8d31-29620909c7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:06.164980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2246b-b8f6-4a07-8d31-29620909c7ea admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:06.184282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 936/1872] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:06.198265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2246b-b8f6-4a07-8d31-29620909c7ea admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:06.214590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:06.220801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2246b-b8f6-4a07-8d31-29620909c7ea admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:06.229518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea43a3-8c83-4c70-8b74-44c7c6543ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:06.230314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea43a3-8c83-4c70-8b74-44c7c6543ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:06.230660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea43a3-8c83-4c70-8b74-44c7c6543ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:06.231119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea43a3-8c83-4c70-8b74-44c7c6543ec8 admin admin] PATH_INFO: `/v3/projects/4b9d72670cb3454ca3e3ff26f52921a8/users/8bd581bd0d7b4a9fa93543b460ccfdc7/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:06.234094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea43a3-8c83-4c70-8b74-44c7c6543ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9d72670cb3454ca3e3ff26f52921a8, user_id=8bd581bd0d7b4a9fa93543b460ccfdc7, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:06.239999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea43a3-8c83-4c70-8b74-44c7c6543ec8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:06.253487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 937/1873] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:06 2022] PUT /identity/v3/projects/4b9d72670cb3454ca3e3ff26f52921a8/users/8bd581bd0d7b4a9fa93543b460ccfdc7/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:06.265247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df18822-c6c5-4a86-bdaf-9f8127468bfc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:06.265797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace54c79-e255-4010-8a23-1d9c5fd2bdfc None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:06.265985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace54c79-e255-4010-8a23-1d9c5fd2bdfc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:06.266272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace54c79-e255-4010-8a23-1d9c5fd2bdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:06.296601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ace54c79-e255-4010-8a23-1d9c5fd2bdfc None None] MFA Rules not processed for user `8bd581bd0d7b4a9fa93543b460ccfdc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:06.298273 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ace54c79-e255-4010-8a23-1d9c5fd2bdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:06.372707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf01dc4-94a8-437c-917a-c389fc06a6e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:06.374190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf01dc4-94a8-437c-917a-c389fc06a6e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:06.374535 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf01dc4-94a8-437c-917a-c389fc06a6e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:06.374906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf01dc4-94a8-437c-917a-c389fc06a6e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:06.414491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 938/1874] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:06.469266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf01dc4-94a8-437c-917a-c389fc06a6e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:06.472269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf01dc4-94a8-437c-917a-c389fc06a6e3 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:06.494669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 937/1875] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:06 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:06.557382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace54c79-e255-4010-8a23-1d9c5fd2bdfc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:06.569400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace54c79-e255-4010-8a23-1d9c5fd2bdfc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:06.573803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451dfb-daea-4f0e-8ccf-5fbce14ef9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:06.574748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451dfb-daea-4f0e-8ccf-5fbce14ef9da service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:06.574959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451dfb-daea-4f0e-8ccf-5fbce14ef9da service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:06.575396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451dfb-daea-4f0e-8ccf-5fbce14ef9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:06.587441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45451dfb-daea-4f0e-8ccf-5fbce14ef9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:06.588920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45451dfb-daea-4f0e-8ccf-5fbce14ef9da service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:06.602379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 939/1876] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:06.678800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf01dc4-94a8-437c-917a-c389fc06a6e3 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:06.688108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf01dc4-94a8-437c-917a-c389fc06a6e3 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:06.695384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b406bf-50e8-4662-b237-4dd04b0ab1fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:06.695384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b406bf-50e8-4662-b237-4dd04b0ab1fd service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:06.695384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b406bf-50e8-4662-b237-4dd04b0ab1fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:06.695384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b406bf-50e8-4662-b237-4dd04b0ab1fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:06.704450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451dfb-daea-4f0e-8ccf-5fbce14ef9da service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:06.705844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:06.706194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-45451dfb-daea-4f0e-8ccf-5fbce14ef9da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:06.719222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451dfb-daea-4f0e-8ccf-5fbce14ef9da service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:06.722907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cc14b-9e09-4c28-9638-7b1f7f0e18f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:06.723586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cc14b-9e09-4c28-9638-7b1f7f0e18f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:06.723979 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cc14b-9e09-4c28-9638-7b1f7f0e18f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:06.724802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cc14b-9e09-4c28-9638-7b1f7f0e18f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:06.782710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b406bf-50e8-4662-b237-4dd04b0ab1fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:06.784207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b406bf-50e8-4662-b237-4dd04b0ab1fd service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:06.794459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cc14b-9e09-4c28-9638-7b1f7f0e18f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:06.795343 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 938/1877] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:06.796050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cc14b-9e09-4c28-9638-7b1f7f0e18f3 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:06.806371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 940/1878] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:06 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:09.070860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b406bf-50e8-4662-b237-4dd04b0ab1fd service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:09.084785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b406bf-50e8-4662-b237-4dd04b0ab1fd service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:09.094889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f700c-12f8-4510-a254-815b238fabd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:09.095782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f700c-12f8-4510-a254-815b238fabd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:09.097729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f700c-12f8-4510-a254-815b238fabd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:09.099857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f700c-12f8-4510-a254-815b238fabd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:09.103257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ca0f700c-12f8-4510-a254-815b238fabd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:09.275858 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f700c-12f8-4510-a254-815b238fabd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:09.278785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f700c-12f8-4510-a254-815b238fabd7 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:09.305390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 939/1879] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:10.500902 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cc14b-9e09-4c28-9638-7b1f7f0e18f3 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:10.597950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cc14b-9e09-4c28-9638-7b1f7f0e18f3 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:10.604937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:10.605772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:10.606132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:10.607206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] PATH_INFO: `/v3/users/5f4d9dbd42bb408db3e463a4c9bbd170` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:10.610827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4d9dbd42bb408db3e463a4c9bbd170)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:10.630793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:10.633898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:10.719118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4d9dbd42bb408db3e463a4c9bbd170'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:10.720847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4d9dbd42bb408db3e463a4c9bbd170'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:10.739749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4d9dbd42bb408db3e463a4c9bbd170'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:10.753353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4d9dbd42bb408db3e463a4c9bbd170'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:10.754072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4d9dbd42bb408db3e463a4c9bbd170'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:10.780443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 941/1880] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:10 2022] DELETE /identity/v3/users/5f4d9dbd42bb408db3e463a4c9bbd170 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:10.782470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e369cc-2692-4d4f-8ccd-45d40b08e277 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:10.783339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e369cc-2692-4d4f-8ccd-45d40b08e277 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:10.783906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e369cc-2692-4d4f-8ccd-45d40b08e277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:10.808722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-17e369cc-2692-4d4f-8ccd-45d40b08e277 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:10.814442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17e369cc-2692-4d4f-8ccd-45d40b08e277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:10.925773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 940/1881] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:10.936460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:10.938261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:11.020063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51de32-665c-4c70-bcc6-0d12aeedadc1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:11.026878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efe498-31d9-4af3-8f1b-20d17705be42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:11.027679 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efe498-31d9-4af3-8f1b-20d17705be42 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:11.027963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efe498-31d9-4af3-8f1b-20d17705be42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:11.028488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efe498-31d9-4af3-8f1b-20d17705be42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:11.053483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efe498-31d9-4af3-8f1b-20d17705be42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:11.055302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efe498-31d9-4af3-8f1b-20d17705be42 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:11.069370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 942/1882] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:11.482569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e369cc-2692-4d4f-8ccd-45d40b08e277 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:11.484577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-17e369cc-2692-4d4f-8ccd-45d40b08e277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:11.512190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e369cc-2692-4d4f-8ccd-45d40b08e277 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:11.517737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:11.518401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:11.518681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:11.518949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] PATH_INFO: `/v3/users/a2c5a5a98a8d4ad49ea0f23dcd4d787b` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:11.520208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c5a5a98a8d4ad49ea0f23dcd4d787b)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:11.522228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:11.570816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:11.589101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c5a5a98a8d4ad49ea0f23dcd4d787b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.590033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c5a5a98a8d4ad49ea0f23dcd4d787b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.622027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c5a5a98a8d4ad49ea0f23dcd4d787b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.629476 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efe498-31d9-4af3-8f1b-20d17705be42 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:11.633161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-28efe498-31d9-4af3-8f1b-20d17705be42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:11.649025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c5a5a98a8d4ad49ea0f23dcd4d787b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.650397 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efe498-31d9-4af3-8f1b-20d17705be42 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:11.658321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:11.659243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:11.659706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:11.659985 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] PATH_INFO: `/v3/projects/4c0a977685e04f3dbca8305443d5c16e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:11.660625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c38d64f3-b107-4481-978a-2fae062f149a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c5a5a98a8d4ad49ea0f23dcd4d787b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.662204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0a977685e04f3dbca8305443d5c16e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:11.664612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:11.673573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 941/1883] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:11 2022] DELETE /identity/v3/users/a2c5a5a98a8d4ad49ea0f23dcd4d787b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:11.678930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d58e9-fde2-46c5-8546-5b67b0219b28 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:11.679326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d58e9-fde2-46c5-8546-5b67b0219b28 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:11.679600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d58e9-fde2-46c5-8546-5b67b0219b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:11.714744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cd2d58e9-fde2-46c5-8546-5b67b0219b28 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:11.716922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cd2d58e9-fde2-46c5-8546-5b67b0219b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:11.777309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0a977685e04f3dbca8305443d5c16e', 'request_id': 'req-457317fd-9922-4480-b89e-e8bd1f6a1c2a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.788720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0a977685e04f3dbca8305443d5c16e', 'request_id': 'req-457317fd-9922-4480-b89e-e8bd1f6a1c2a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.807715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0a977685e04f3dbca8305443d5c16e', 'request_id': 'req-457317fd-9922-4480-b89e-e8bd1f6a1c2a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.832577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 942/1884] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:11.840802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] The token cache is being invalidate because project 4c0a977685e04f3dbca8305443d5c16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:11.841252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.842698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:11.847099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 943/1885] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:11 2022] DELETE /identity/v3/projects/4c0a977685e04f3dbca8305443d5c16e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:11.849541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d58e9-fde2-46c5-8546-5b67b0219b28 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:11.851271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:11.854774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:11.856495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cd2d58e9-fde2-46c5-8546-5b67b0219b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:11.878436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:11.979400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d58e9-fde2-46c5-8546-5b67b0219b28 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:12.003434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457317fd-9922-4480-b89e-e8bd1f6a1c2a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:12.011025 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:12.011980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:12.012298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:12.012819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] PATH_INFO: `/v3/users/705d133af0664981bb7267a3cb68e436` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:12.014735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=705d133af0664981bb7267a3cb68e436)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:12.020052 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:12.038770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:12.039432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:12.039710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:12.039981 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:12.042507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:12.070284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:12.072348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:12.089287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 943/1886] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:12.103534 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705d133af0664981bb7267a3cb68e436'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.104453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705d133af0664981bb7267a3cb68e436'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.121338 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705d133af0664981bb7267a3cb68e436'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.133578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705d133af0664981bb7267a3cb68e436'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.134571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705d133af0664981bb7267a3cb68e436'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.156598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 944/1887] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:11 2022] DELETE /identity/v3/users/705d133af0664981bb7267a3cb68e436 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:12.461195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:12.463338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:12.489277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93991a8c-33d0-4752-a632-f25f2b74ca7f service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:12.501985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:12.515818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:12.517277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:12.619580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb808d0-b161-45d5-8955-66c159f5b4bf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:12.634315 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:12.634529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:12.635221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:12.635720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:12.636199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] PATH_INFO: `/v3/projects/7f1aa4b393894a3d8b6d8e558283dbff` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:12.636356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:12.636703 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:12.637118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] PATH_INFO: `/v3/projects/d979ff54407b471883898e359ce52609` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:12.638418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1aa4b393894a3d8b6d8e558283dbff)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:12.639116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d979ff54407b471883898e359ce52609)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:12.641537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:12.642108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:12.697560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:12.704095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd979ff54407b471883898e359ce52609', 'request_id': 'req-f4b66603-1620-45b5-9b4b-0cbd145d16e7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.710960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd979ff54407b471883898e359ce52609', 'request_id': 'req-f4b66603-1620-45b5-9b4b-0cbd145d16e7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.716224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1aa4b393894a3d8b6d8e558283dbff', 'request_id': 'req-f1135e4b-9356-497f-b63c-248ad04fca62'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.719958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd979ff54407b471883898e359ce52609', 'request_id': 'req-f4b66603-1620-45b5-9b4b-0cbd145d16e7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.723315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1aa4b393894a3d8b6d8e558283dbff', 'request_id': 'req-f1135e4b-9356-497f-b63c-248ad04fca62'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.737049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] The token cache is being invalidate because project d979ff54407b471883898e359ce52609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:12.737248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1aa4b393894a3d8b6d8e558283dbff', 'request_id': 'req-f1135e4b-9356-497f-b63c-248ad04fca62'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.737732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.738605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.743838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 944/1888] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:12 2022] DELETE /identity/v3/projects/d979ff54407b471883898e359ce52609 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:12.744365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:12.746206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:12.753686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] The token cache is being invalidate because project 7f1aa4b393894a3d8b6d8e558283dbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:12.753686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.754272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.756725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 945/1889] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:12 2022] DELETE /identity/v3/projects/7f1aa4b393894a3d8b6d8e558283dbff => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:12.762024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:12.764202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:12.835742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b66603-1620-45b5-9b4b-0cbd145d16e7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:12.859790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135e4b-9356-497f-b63c-248ad04fca62 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:12.865779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:12.866689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:12.866689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:12.867089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] PATH_INFO: `/v3/users/8bd581bd0d7b4a9fa93543b460ccfdc7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:12.868192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd581bd0d7b4a9fa93543b460ccfdc7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:12.870200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:12.894294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:12.918241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:12.918922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:12.919240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:12.919534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] PATH_INFO: `/v3/users/2369c5fd0a98463aa9c3f1f6d0fb571a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:12.921539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2369c5fd0a98463aa9c3f1f6d0fb571a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:12.923711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:12.935123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd581bd0d7b4a9fa93543b460ccfdc7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.935974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd581bd0d7b4a9fa93543b460ccfdc7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.953512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd581bd0d7b4a9fa93543b460ccfdc7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.963506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd581bd0d7b4a9fa93543b460ccfdc7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.964684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3d50de50-d011-4c9d-96cc-79cd76105423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd581bd0d7b4a9fa93543b460ccfdc7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.978123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2369c5fd0a98463aa9c3f1f6d0fb571a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.978859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2369c5fd0a98463aa9c3f1f6d0fb571a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:12.982526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 946/1890] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:12 2022] DELETE /identity/v3/users/8bd581bd0d7b4a9fa93543b460ccfdc7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:12.996867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2369c5fd0a98463aa9c3f1f6d0fb571a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:13.008710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2369c5fd0a98463aa9c3f1f6d0fb571a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:13.017747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4d7ec69-530a-431d-b0d7-0c2ae0e71a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2369c5fd0a98463aa9c3f1f6d0fb571a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:13.026653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 945/1891] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:12 2022] DELETE /identity/v3/users/2369c5fd0a98463aa9c3f1f6d0fb571a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:13.211102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57798332-5508-46a3-91b3-b569283541f6 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:13.211397 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57798332-5508-46a3-91b3-b569283541f6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:13.213948 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57798332-5508-46a3-91b3-b569283541f6 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:13.220230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 947/1892] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:41:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:41:13.246243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61c0ce-4c88-43b3-940c-cf17e137e719 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:13.246611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61c0ce-4c88-43b3-940c-cf17e137e719 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:13.246849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61c0ce-4c88-43b3-940c-cf17e137e719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:13.284452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9a61c0ce-4c88-43b3-940c-cf17e137e719 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:13.285711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9a61c0ce-4c88-43b3-940c-cf17e137e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:13.441309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 946/1893] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:41:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:13.466904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57798332-5508-46a3-91b3-b569283541f6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:13.474730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-57798332-5508-46a3-91b3-b569283541f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:13.509500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57798332-5508-46a3-91b3-b569283541f6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:13.518774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2ff26-eb39-4792-86f4-220eae08da1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:13.519862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2ff26-eb39-4792-86f4-220eae08da1b service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:13.520156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2ff26-eb39-4792-86f4-220eae08da1b service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:13.520532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2ff26-eb39-4792-86f4-220eae08da1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:13.543425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2ff26-eb39-4792-86f4-220eae08da1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:13.543425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2ff26-eb39-4792-86f4-220eae08da1b service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:13.559212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 948/1894] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:13.719317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61c0ce-4c88-43b3-940c-cf17e137e719 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:13.720805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9a61c0ce-4c88-43b3-940c-cf17e137e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:13.796112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2ff26-eb39-4792-86f4-220eae08da1b service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:13.798589 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e9a2ff26-eb39-4792-86f4-220eae08da1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:13.934858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:14.009520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61c0ce-4c88-43b3-940c-cf17e137e719 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.021266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.023336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.024900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.024900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] PATH_INFO: `/v3/projects/4b9d72670cb3454ca3e3ff26f52921a8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.028749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9d72670cb3454ca3e3ff26f52921a8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.033496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.039356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:14.054418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2ff26-eb39-4792-86f4-220eae08da1b service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.066769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.067720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.070726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.071157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] PATH_INFO: `/v3/projects/064ddce943fa483b9d6a04f47eab963c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.073187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064ddce943fa483b9d6a04f47eab963c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.078324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.138361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9d72670cb3454ca3e3ff26f52921a8', 'request_id': 'req-beb7eab9-61ef-42a1-985d-cf433d6d8310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.149364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9d72670cb3454ca3e3ff26f52921a8', 'request_id': 'req-beb7eab9-61ef-42a1-985d-cf433d6d8310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.163027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9d72670cb3454ca3e3ff26f52921a8', 'request_id': 'req-beb7eab9-61ef-42a1-985d-cf433d6d8310'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.169681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064ddce943fa483b9d6a04f47eab963c', 'request_id': 'req-64085687-09f4-4b90-b1e7-d20dc4a9b642'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.178935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064ddce943fa483b9d6a04f47eab963c', 'request_id': 'req-64085687-09f4-4b90-b1e7-d20dc4a9b642'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.186032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] The token cache is being invalidate because project 4b9d72670cb3454ca3e3ff26f52921a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:14.186686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.188563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-beb7eab9-61ef-42a1-985d-cf433d6d8310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.193630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064ddce943fa483b9d6a04f47eab963c', 'request_id': 'req-64085687-09f4-4b90-b1e7-d20dc4a9b642'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.194373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 947/1895] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:13 2022] DELETE /identity/v3/projects/4b9d72670cb3454ca3e3ff26f52921a8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:14.200255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22d01-7149-492b-9861-acf7484293fb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.201169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22d01-7149-492b-9861-acf7484293fb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.202654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22d01-7149-492b-9861-acf7484293fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.209485 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] The token cache is being invalidate because project 064ddce943fa483b9d6a04f47eab963c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:14.211608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.215311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-64085687-09f4-4b90-b1e7-d20dc4a9b642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:14.223080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 949/1896] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:13 2022] DELETE /identity/v3/projects/064ddce943fa483b9d6a04f47eab963c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:14.226849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c6e59-23da-4019-8882-4ef8e77a9cc7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.227423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c6e59-23da-4019-8882-4ef8e77a9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.227815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c6e59-23da-4019-8882-4ef8e77a9cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.242237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4bc22d01-7149-492b-9861-acf7484293fb None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:14.243663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4bc22d01-7149-492b-9861-acf7484293fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:14.251824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9b0c6e59-23da-4019-8882-4ef8e77a9cc7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:14.253036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9b0c6e59-23da-4019-8882-4ef8e77a9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:14.340277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 950/1897] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:14.347904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f264-d939-404f-93bf-22599ce681db None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.348785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f264-d939-404f-93bf-22599ce681db None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.350278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f264-d939-404f-93bf-22599ce681db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.352694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 948/1898] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:14.367426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab08c9b-382b-4b48-a53f-42f574055638 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.367759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab08c9b-382b-4b48-a53f-42f574055638 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.368040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab08c9b-382b-4b48-a53f-42f574055638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.376052 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6f93f264-d939-404f-93bf-22599ce681db None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:14.377906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6f93f264-d939-404f-93bf-22599ce681db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:14.389913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 951/1899] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:14.394607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93f264-d939-404f-93bf-22599ce681db None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.406096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8ab08c9b-382b-4b48-a53f-42f574055638 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:14.407872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8ab08c9b-382b-4b48-a53f-42f574055638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:14.413459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93f264-d939-404f-93bf-22599ce681db None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.421438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dcc19-b4b3-4df6-b04a-58388b8e39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.423605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dcc19-b4b3-4df6-b04a-58388b8e39b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.424123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dcc19-b4b3-4df6-b04a-58388b8e39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.424657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dcc19-b4b3-4df6-b04a-58388b8e39b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.426889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dcc19-b4b3-4df6-b04a-58388b8e39b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:14.427402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 949/1900] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:14.427885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dcc19-b4b3-4df6-b04a-58388b8e39b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.428348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab08c9b-382b-4b48-a53f-42f574055638 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.430220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dcc19-b4b3-4df6-b04a-58388b8e39b5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.440633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab08c9b-382b-4b48-a53f-42f574055638 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.447415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ecabf-925c-472b-863a-e0c115bb56de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.448303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ecabf-925c-472b-863a-e0c115bb56de admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.448794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ecabf-925c-472b-863a-e0c115bb56de admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.449277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ecabf-925c-472b-863a-e0c115bb56de admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.449806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 952/1901] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:41:14.450472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ecabf-925c-472b-863a-e0c115bb56de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:14.450975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ecabf-925c-472b-863a-e0c115bb56de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.452971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ecabf-925c-472b-863a-e0c115bb56de admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.453859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dcc19-b4b3-4df6-b04a-58388b8e39b5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.468337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 950/1902] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:14.472879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ecabf-925c-472b-863a-e0c115bb56de admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.483227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dcc19-b4b3-4df6-b04a-58388b8e39b5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.489062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ecabf-925c-472b-863a-e0c115bb56de admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.493417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa33951-c8e9-4ba5-aeab-fe894d890584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.494020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa33951-c8e9-4ba5-aeab-fe894d890584 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.494339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa33951-c8e9-4ba5-aeab-fe894d890584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.494631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa33951-c8e9-4ba5-aeab-fe894d890584 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.495673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa33951-c8e9-4ba5-aeab-fe894d890584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.498520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a1996-2e17-4925-9ddd-fa52cb43e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.498685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa33951-c8e9-4ba5-aeab-fe894d890584 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.507722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a1996-2e17-4925-9ddd-fa52cb43e42f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.507722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a1996-2e17-4925-9ddd-fa52cb43e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.507722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a1996-2e17-4925-9ddd-fa52cb43e42f admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.507722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a1996-2e17-4925-9ddd-fa52cb43e42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.508011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a1996-2e17-4925-9ddd-fa52cb43e42f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.567482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 951/1903] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:14 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:14.569318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a1996-2e17-4925-9ddd-fa52cb43e42f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.579891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 953/1904] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:14 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:14.584372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa33951-c8e9-4ba5-aeab-fe894d890584 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.602819 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:14.677593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:14.698970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a1996-2e17-4925-9ddd-fa52cb43e42f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.705052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32023d-f0bc-4137-b743-d91e9d34696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.705683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32023d-f0bc-4137-b743-d91e9d34696f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.705957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32023d-f0bc-4137-b743-d91e9d34696f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.706224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32023d-f0bc-4137-b743-d91e9d34696f admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.706495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa33951-c8e9-4ba5-aeab-fe894d890584 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.706879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32023d-f0bc-4137-b743-d91e9d34696f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.710306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32023d-f0bc-4137-b743-d91e9d34696f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.714318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1ba7-3fc8-4c56-a80d-f7586d73f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.716000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1ba7-3fc8-4c56-a80d-f7586d73f6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.716187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1ba7-3fc8-4c56-a80d-f7586d73f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.716455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d1ba7-3fc8-4c56-a80d-f7586d73f6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.717415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1ba7-3fc8-4c56-a80d-f7586d73f6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.720855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d1ba7-3fc8-4c56-a80d-f7586d73f6b6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.745654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 952/1905] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:14 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:14.750446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32023d-f0bc-4137-b743-d91e9d34696f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.756574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 954/1906] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:14 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:14.762784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1ba7-3fc8-4c56-a80d-f7586d73f6b6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.773307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32023d-f0bc-4137-b743-d91e9d34696f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.778557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4e6f-ad53-407a-aa50-498e92c23e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.778875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d1ba7-3fc8-4c56-a80d-f7586d73f6b6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.779389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4e6f-ad53-407a-aa50-498e92c23e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.779679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4e6f-ad53-407a-aa50-498e92c23e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.779956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4e6f-ad53-407a-aa50-498e92c23e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.780677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c4e6f-ad53-407a-aa50-498e92c23e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.782328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c4e6f-ad53-407a-aa50-498e92c23e92 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.787616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf9ce7-09f5-47ba-b92c-f907d7019ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.788636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf9ce7-09f5-47ba-b92c-f907d7019ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.789749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf9ce7-09f5-47ba-b92c-f907d7019ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.791757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf9ce7-09f5-47ba-b92c-f907d7019ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.793037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf9ce7-09f5-47ba-b92c-f907d7019ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.795912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf9ce7-09f5-47ba-b92c-f907d7019ed9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.803337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 953/1907] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:14.804152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4e6f-ad53-407a-aa50-498e92c23e92 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.810418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 955/1908] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:14.815972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf9ce7-09f5-47ba-b92c-f907d7019ed9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.822323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4e6f-ad53-407a-aa50-498e92c23e92 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.834060 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf9ce7-09f5-47ba-b92c-f907d7019ed9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.834675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a474c-92f2-4c54-8944-7e175dc311dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.836216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a474c-92f2-4c54-8944-7e175dc311dd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.836506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a474c-92f2-4c54-8944-7e175dc311dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.836780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a474c-92f2-4c54-8944-7e175dc311dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.837498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a474c-92f2-4c54-8944-7e175dc311dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.839309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a474c-92f2-4c54-8944-7e175dc311dd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.845049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c4644-58b7-4ba1-b4ee-e562c005176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.846855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c4644-58b7-4ba1-b4ee-e562c005176d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.848297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c4644-58b7-4ba1-b4ee-e562c005176d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.848806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c4644-58b7-4ba1-b4ee-e562c005176d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.850421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c4644-58b7-4ba1-b4ee-e562c005176d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.854906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c4644-58b7-4ba1-b4ee-e562c005176d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.865332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 954/1909] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:14.872090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a474c-92f2-4c54-8944-7e175dc311dd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.876960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 956/1910] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:14.881067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c4644-58b7-4ba1-b4ee-e562c005176d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:14.897342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c4644-58b7-4ba1-b4ee-e562c005176d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.904152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a474c-92f2-4c54-8944-7e175dc311dd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:14.905994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76eaa1-dd8b-4b97-96ff-40927cefb69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.907024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76eaa1-dd8b-4b97-96ff-40927cefb69d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.907924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76eaa1-dd8b-4b97-96ff-40927cefb69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.908421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76eaa1-dd8b-4b97-96ff-40927cefb69d admin admin] PATH_INFO: `/v3/projects/d628856b25964ad0a04fa18e63310d8e/users/1082a31368be4f61b329a5f6f435b564/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.920160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912a8fb-08d6-4a72-8da4-3f59f2e2830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:14.920860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912a8fb-08d6-4a72-8da4-3f59f2e2830e admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.921140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912a8fb-08d6-4a72-8da4-3f59f2e2830e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.921413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912a8fb-08d6-4a72-8da4-3f59f2e2830e admin admin] PATH_INFO: `/v3/projects/9c9dbe4b59044006bb9f64f54ef2713f/users/bf7f1da9e4254669a182c35679eebd7f/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:14.935270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76eaa1-dd8b-4b97-96ff-40927cefb69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d628856b25964ad0a04fa18e63310d8e, user_id=1082a31368be4f61b329a5f6f435b564, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.939299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76eaa1-dd8b-4b97-96ff-40927cefb69d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.987522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 957/1911] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:14 2022] PUT /identity/v3/projects/d628856b25964ad0a04fa18e63310d8e/users/1082a31368be4f61b329a5f6f435b564/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:14.988379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912a8fb-08d6-4a72-8da4-3f59f2e2830e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9dbe4b59044006bb9f64f54ef2713f, user_id=bf7f1da9e4254669a182c35679eebd7f, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:14.991581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912a8fb-08d6-4a72-8da4-3f59f2e2830e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:14.992600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80c5d5-b136-452c-b6b2-0596757c9575 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:14.993244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80c5d5-b136-452c-b6b2-0596757c9575 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:14.993831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80c5d5-b136-452c-b6b2-0596757c9575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.018507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 955/1912] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:14 2022] PUT /identity/v3/projects/9c9dbe4b59044006bb9f64f54ef2713f/users/bf7f1da9e4254669a182c35679eebd7f/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:15.022244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912a8fb-08d6-4a72-8da4-3f59f2e2830e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:15.024046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4912a8fb-08d6-4a72-8da4-3f59f2e2830e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.025031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ce80c5d5-b136-452c-b6b2-0596757c9575 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:15.026411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ce80c5d5-b136-452c-b6b2-0596757c9575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.103031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 958/1913] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:15.103031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef9850-8e9c-477e-bc7f-df8351f50c15 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:15.103031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef9850-8e9c-477e-bc7f-df8351f50c15 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:15.103031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef9850-8e9c-477e-bc7f-df8351f50c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.123854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912a8fb-08d6-4a72-8da4-3f59f2e2830e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:15.129025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:15.129665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:15.129944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:15.130378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] PATH_INFO: `/v3/users/c43920b4fe4c4b138ab18c310d6b2ae0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.131737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43920b4fe4c4b138ab18c310d6b2ae0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:15.133648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:15.136928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8eef9850-8e9c-477e-bc7f-df8351f50c15 None None] MFA Rules not processed for user `bf7f1da9e4254669a182c35679eebd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:15.138221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8eef9850-8e9c-477e-bc7f-df8351f50c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.184771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43920b4fe4c4b138ab18c310d6b2ae0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.185499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43920b4fe4c4b138ab18c310d6b2ae0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.188832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:15.199146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43920b4fe4c4b138ab18c310d6b2ae0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.206199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43920b4fe4c4b138ab18c310d6b2ae0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.212891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 959/1914] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:15.214322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43920b4fe4c4b138ab18c310d6b2ae0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.215893 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef9850-8e9c-477e-bc7f-df8351f50c15 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:15.218064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8eef9850-8e9c-477e-bc7f-df8351f50c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.224734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 956/1915] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:15 2022] DELETE /identity/v3/users/c43920b4fe4c4b138ab18c310d6b2ae0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:15.225573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:15.228435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.243563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:15.286102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef9850-8e9c-477e-bc7f-df8351f50c15 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:15.292261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905559f-a85f-46b3-8f23-095d195fbc43 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:15.296275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc386926-8ec4-4900-8906-12bcecf36a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:15.296935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386926-8ec4-4900-8906-12bcecf36a51 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:15.297291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386926-8ec4-4900-8906-12bcecf36a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:15.297566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc386926-8ec4-4900-8906-12bcecf36a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.299471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fc386926-8ec4-4900-8906-12bcecf36a51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.343663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:15.344349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:15.344641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:15.344920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.346712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.378149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc386926-8ec4-4900-8906-12bcecf36a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:15.379712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc386926-8ec4-4900-8906-12bcecf36a51 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:15.391218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 957/1916] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:15.392513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d32b9e-a78c-4f89-a353-b7e01b98def6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:15.392833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d32b9e-a78c-4f89-a353-b7e01b98def6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:15.393086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d32b9e-a78c-4f89-a353-b7e01b98def6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.419910 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-14d32b9e-a78c-4f89-a353-b7e01b98def6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:15.420461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-14d32b9e-a78c-4f89-a353-b7e01b98def6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.442779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:15.443550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:15.455402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 960/1917] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:15.456006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:15.457868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.471355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab083d78-b3bd-4a38-a98b-808de1a7f736 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:15.477135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:15.477566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:15.477923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:15.478333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] PATH_INFO: `/v3/users/bf7f1da9e4254669a182c35679eebd7f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.479945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7f1da9e4254669a182c35679eebd7f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:15.483013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:15.506599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 958/1918] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:15.514198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d32b9e-a78c-4f89-a353-b7e01b98def6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:15.516166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-14d32b9e-a78c-4f89-a353-b7e01b98def6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.533436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d32b9e-a78c-4f89-a353-b7e01b98def6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:15.538090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1ea53-f80b-4f3d-9656-9f731733134a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:15.539089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1ea53-f80b-4f3d-9656-9f731733134a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:15.539334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1ea53-f80b-4f3d-9656-9f731733134a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:15.539702 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1ea53-f80b-4f3d-9656-9f731733134a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.550539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1ea53-f80b-4f3d-9656-9f731733134a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:15.552590 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1ea53-f80b-4f3d-9656-9f731733134a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:15.555334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:15.558143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7f1da9e4254669a182c35679eebd7f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.558755 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7f1da9e4254669a182c35679eebd7f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.570833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 959/1919] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:15.576376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7f1da9e4254669a182c35679eebd7f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.586525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7f1da9e4254669a182c35679eebd7f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.587193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7f1da9e4254669a182c35679eebd7f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:15.604756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 961/1920] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:15 2022] DELETE /identity/v3/users/bf7f1da9e4254669a182c35679eebd7f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:15.610605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba5f5-5243-4e6d-b1c9-2e89d2375292 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:15.611262 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba5f5-5243-4e6d-b1c9-2e89d2375292 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:15.611403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba5f5-5243-4e6d-b1c9-2e89d2375292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.654779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-221ba5f5-5243-4e6d-b1c9-2e89d2375292 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:15.654779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-221ba5f5-5243-4e6d-b1c9-2e89d2375292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.745401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:15.771156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 960/1921] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:15.799015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:15.800554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:15.949862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42749-dd51-462d-8403-96663115bfbe admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:15.956731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d562c3-9daa-4a4e-be32-aad9fba2a75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:15.957478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d562c3-9daa-4a4e-be32-aad9fba2a75b service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:15.957795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d562c3-9daa-4a4e-be32-aad9fba2a75b service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:15.958693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d562c3-9daa-4a4e-be32-aad9fba2a75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:15.996600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d562c3-9daa-4a4e-be32-aad9fba2a75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:15.998609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d562c3-9daa-4a4e-be32-aad9fba2a75b service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:16.015400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba5f5-5243-4e6d-b1c9-2e89d2375292 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:16.019929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-221ba5f5-5243-4e6d-b1c9-2e89d2375292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:16.040010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 962/1922] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:16.051228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba5f5-5243-4e6d-b1c9-2e89d2375292 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:16.079013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:16.080198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:16.083688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:16.084083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] PATH_INFO: `/v3/projects/f14d7bb2b3ad4167aca5ad3c00628c97` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:16.085682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14d7bb2b3ad4167aca5ad3c00628c97)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:16.092194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:16.212931 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14d7bb2b3ad4167aca5ad3c00628c97', 'request_id': 'req-c85f009f-b6b5-48a4-bc23-e35b2068f286'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.225673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14d7bb2b3ad4167aca5ad3c00628c97', 'request_id': 'req-c85f009f-b6b5-48a4-bc23-e35b2068f286'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.236122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14d7bb2b3ad4167aca5ad3c00628c97', 'request_id': 'req-c85f009f-b6b5-48a4-bc23-e35b2068f286'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.252494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] The token cache is being invalidate because project f14d7bb2b3ad4167aca5ad3c00628c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:16.252890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.253506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c85f009f-b6b5-48a4-bc23-e35b2068f286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.255511 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 961/1923] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:16 2022] DELETE /identity/v3/projects/f14d7bb2b3ad4167aca5ad3c00628c97 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:16.259475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d562c3-9daa-4a4e-be32-aad9fba2a75b service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:16.278969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d562c3-9daa-4a4e-be32-aad9fba2a75b service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:16.368491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:16.369851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:16.370250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:16.370414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] PATH_INFO: `/v3/users/119ea75588764a2e871f233d07343a15` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:16.375256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] RBAC: Authorizing `identity:delete_user(user_id=119ea75588764a2e871f233d07343a15)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:16.379432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:16.486165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119ea75588764a2e871f233d07343a15'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.487661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119ea75588764a2e871f233d07343a15'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.511346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119ea75588764a2e871f233d07343a15'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.514505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:16.523443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119ea75588764a2e871f233d07343a15'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.524521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119ea75588764a2e871f233d07343a15'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:16.551591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 963/1924] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:16 2022] DELETE /identity/v3/users/119ea75588764a2e871f233d07343a15 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:17.025799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da514ad9-8842-4168-b317-888bc62af4eb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.026295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da514ad9-8842-4168-b317-888bc62af4eb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.026374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da514ad9-8842-4168-b317-888bc62af4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.044597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.046023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.064288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-da514ad9-8842-4168-b317-888bc62af4eb None None] MFA Rules not processed for user `1082a31368be4f61b329a5f6f435b564`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:17.065596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da514ad9-8842-4168-b317-888bc62af4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.174176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 962/1925] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:17.174734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7efcc-87e8-49f8-92ef-c57ff824677a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.175336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da514ad9-8842-4168-b317-888bc62af4eb None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.177949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-da514ad9-8842-4168-b317-888bc62af4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.182250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.183222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.183501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.183771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] PATH_INFO: `/v3/projects/9c9dbe4b59044006bb9f64f54ef2713f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.185480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9dbe4b59044006bb9f64f54ef2713f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.187435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.194878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da514ad9-8842-4168-b317-888bc62af4eb None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.201205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00f061-730c-4fce-8399-eb0afe411b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.202128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00f061-730c-4fce-8399-eb0afe411b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.202602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00f061-730c-4fce-8399-eb0afe411b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.203055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00f061-730c-4fce-8399-eb0afe411b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.203939 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00f061-730c-4fce-8399-eb0afe411b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.217091 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00f061-730c-4fce-8399-eb0afe411b3b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.278906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9dbe4b59044006bb9f64f54ef2713f', 'request_id': 'req-e9d319f8-b72d-4af5-b562-c2ab81f169bf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.288390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 963/1926] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:17 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:17.290120 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9dbe4b59044006bb9f64f54ef2713f', 'request_id': 'req-e9d319f8-b72d-4af5-b562-c2ab81f169bf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.292604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00f061-730c-4fce-8399-eb0afe411b3b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.306193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9dbe4b59044006bb9f64f54ef2713f', 'request_id': 'req-e9d319f8-b72d-4af5-b562-c2ab81f169bf'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.331784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] The token cache is being invalidate because project 9c9dbe4b59044006bb9f64f54ef2713f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:17.332334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.335823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.341009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 964/1927] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:17 2022] DELETE /identity/v3/projects/9c9dbe4b59044006bb9f64f54ef2713f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:17.341009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.341009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.361847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:17.381751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00f061-730c-4fce-8399-eb0afe411b3b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.387273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d8f08-be4a-4779-9f54-9a868e6f9ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.388336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d8f08-be4a-4779-9f54-9a868e6f9ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.388553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d8f08-be4a-4779-9f54-9a868e6f9ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.389036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d8f08-be4a-4779-9f54-9a868e6f9ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.390181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d8f08-be4a-4779-9f54-9a868e6f9ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.392125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d8f08-be4a-4779-9f54-9a868e6f9ea3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.416515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d319f8-b72d-4af5-b562-c2ab81f169bf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.418059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 964/1928] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:17 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:17.422287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3bc43-6344-4f37-829b-c41942e49f21 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.422405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.422625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3bc43-6344-4f37-829b-c41942e49f21 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.422878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3bc43-6344-4f37-829b-c41942e49f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.423174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.423557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.423838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] PATH_INFO: `/v3/projects/0c52f6d9e27e4c0e80744c056fcae6e1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.425128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c52f6d9e27e4c0e80744c056fcae6e1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.427597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.445986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-10d3bc43-6344-4f37-829b-c41942e49f21 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:17.446189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:17.447226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-10d3bc43-6344-4f37-829b-c41942e49f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.456322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 965/1929] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:17.457356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3bc43-6344-4f37-829b-c41942e49f21 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.458858 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-10d3bc43-6344-4f37-829b-c41942e49f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.472230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3bc43-6344-4f37-829b-c41942e49f21 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.478261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebbe5b-46d0-44c8-a4c2-9f9ccc8ac7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.479149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebbe5b-46d0-44c8-a4c2-9f9ccc8ac7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.479523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebbe5b-46d0-44c8-a4c2-9f9ccc8ac7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.479801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebbe5b-46d0-44c8-a4c2-9f9ccc8ac7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.480700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebbe5b-46d0-44c8-a4c2-9f9ccc8ac7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.482638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebbe5b-46d0-44c8-a4c2-9f9ccc8ac7b6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.495194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c52f6d9e27e4c0e80744c056fcae6e1', 'request_id': 'req-c55e5784-e70a-4789-9cac-f6aa9a5d4136'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.495587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 966/1930] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:17.496888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20deb2-08de-4fd6-a1fc-3dda25ec391b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.497176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20deb2-08de-4fd6-a1fc-3dda25ec391b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.497446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20deb2-08de-4fd6-a1fc-3dda25ec391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.501886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c52f6d9e27e4c0e80744c056fcae6e1', 'request_id': 'req-c55e5784-e70a-4789-9cac-f6aa9a5d4136'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.509640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c52f6d9e27e4c0e80744c056fcae6e1', 'request_id': 'req-c55e5784-e70a-4789-9cac-f6aa9a5d4136'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.518035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6a20deb2-08de-4fd6-a1fc-3dda25ec391b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:17.519280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6a20deb2-08de-4fd6-a1fc-3dda25ec391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.520792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] The token cache is being invalidate because project 0c52f6d9e27e4c0e80744c056fcae6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:17.521142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.522242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:17.523794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 965/1931] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:17 2022] DELETE /identity/v3/projects/0c52f6d9e27e4c0e80744c056fcae6e1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:17.524531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.525795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.584589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 967/1932] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:17.586295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059412a6-19f5-4458-be59-bb7d358c4f46 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.586585 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059412a6-19f5-4458-be59-bb7d358c4f46 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.586860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059412a6-19f5-4458-be59-bb7d358c4f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.598010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e5784-e70a-4789-9cac-f6aa9a5d4136 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.603232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dc738-d6d4-4609-aff2-2090d2ecf83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.603904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dc738-d6d4-4609-aff2-2090d2ecf83d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.604185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dc738-d6d4-4609-aff2-2090d2ecf83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.604459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dc738-d6d4-4609-aff2-2090d2ecf83d admin admin] PATH_INFO: `/v3/projects/4941ad3486f841e2a95508469766cd5f/users/c8d51abc5ed741bab312fe7e68d1bcd6/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.605996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-059412a6-19f5-4458-be59-bb7d358c4f46 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:17.607350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-059412a6-19f5-4458-be59-bb7d358c4f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.616218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 968/1933] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:17.617041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059412a6-19f5-4458-be59-bb7d358c4f46 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.623388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dc738-d6d4-4609-aff2-2090d2ecf83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4941ad3486f841e2a95508469766cd5f, user_id=c8d51abc5ed741bab312fe7e68d1bcd6, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.626063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dc738-d6d4-4609-aff2-2090d2ecf83d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.626494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059412a6-19f5-4458-be59-bb7d358c4f46 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.631372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7239-174d-423b-8b82-9377bc6dadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.632225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7239-174d-423b-8b82-9377bc6dadbb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.632663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7239-174d-423b-8b82-9377bc6dadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.633099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7239-174d-423b-8b82-9377bc6dadbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.633835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7239-174d-423b-8b82-9377bc6dadbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:17.634297 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7239-174d-423b-8b82-9377bc6dadbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.636072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7239-174d-423b-8b82-9377bc6dadbb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.640673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 966/1934] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:17 2022] PUT /identity/v3/projects/4941ad3486f841e2a95508469766cd5f/users/c8d51abc5ed741bab312fe7e68d1bcd6/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:17.641866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563df06a-7220-4eb3-91ac-57a46d2c28ad None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.642156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563df06a-7220-4eb3-91ac-57a46d2c28ad None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.642431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563df06a-7220-4eb3-91ac-57a46d2c28ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.649130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 969/1935] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:17.649796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7239-174d-423b-8b82-9377bc6dadbb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.659680 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7239-174d-423b-8b82-9377bc6dadbb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.667632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-563df06a-7220-4eb3-91ac-57a46d2c28ad None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:17.669318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-563df06a-7220-4eb3-91ac-57a46d2c28ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:17.726877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95452554-0132-4e7e-8fb7-5a40846af35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.727634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95452554-0132-4e7e-8fb7-5a40846af35e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.727924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95452554-0132-4e7e-8fb7-5a40846af35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.728195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95452554-0132-4e7e-8fb7-5a40846af35e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.728900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95452554-0132-4e7e-8fb7-5a40846af35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.730507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95452554-0132-4e7e-8fb7-5a40846af35e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.744592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 970/1936] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:17.744592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95452554-0132-4e7e-8fb7-5a40846af35e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.757580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95452554-0132-4e7e-8fb7-5a40846af35e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.760445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 967/1937] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:17.761282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563df06a-7220-4eb3-91ac-57a46d2c28ad None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.767438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b881b2e-5bc0-48ed-be84-bb116ee12035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.768160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b881b2e-5bc0-48ed-be84-bb116ee12035 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.768442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b881b2e-5bc0-48ed-be84-bb116ee12035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.768857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b881b2e-5bc0-48ed-be84-bb116ee12035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.769742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b881b2e-5bc0-48ed-be84-bb116ee12035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.771993 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b881b2e-5bc0-48ed-be84-bb116ee12035 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.774345 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563df06a-7220-4eb3-91ac-57a46d2c28ad None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.779480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f23aa6-7c93-435f-a5c1-00d6ae2003ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.780358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f23aa6-7c93-435f-a5c1-00d6ae2003ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.780744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f23aa6-7c93-435f-a5c1-00d6ae2003ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.781332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f23aa6-7c93-435f-a5c1-00d6ae2003ff admin admin] PATH_INFO: `/v3/projects/4941ad3486f841e2a95508469766cd5f/users/c8d51abc5ed741bab312fe7e68d1bcd6/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.783264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f23aa6-7c93-435f-a5c1-00d6ae2003ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4941ad3486f841e2a95508469766cd5f, user_id=c8d51abc5ed741bab312fe7e68d1bcd6, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.789023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f23aa6-7c93-435f-a5c1-00d6ae2003ff admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.814541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 971/1938] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:17 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:17.814541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b881b2e-5bc0-48ed-be84-bb116ee12035 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.815263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 968/1939] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:17 2022] PUT /identity/v3/projects/4941ad3486f841e2a95508469766cd5f/users/c8d51abc5ed741bab312fe7e68d1bcd6/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:17.818192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f23aa6-7c93-435f-a5c1-00d6ae2003ff admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:17.839179 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:17.844905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:17.956765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f23aa6-7c93-435f-a5c1-00d6ae2003ff admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.962319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acac8f1-6273-44a6-8cf5-c7555f034fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.962957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac8f1-6273-44a6-8cf5-c7555f034fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.963297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac8f1-6273-44a6-8cf5-c7555f034fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.963608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acac8f1-6273-44a6-8cf5-c7555f034fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.964331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acac8f1-6273-44a6-8cf5-c7555f034fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.966370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acac8f1-6273-44a6-8cf5-c7555f034fe9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:17.967526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b881b2e-5bc0-48ed-be84-bb116ee12035 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:17.981839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d3062-ca2b-4f19-820f-c3b0d896a532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:17.983810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d3062-ca2b-4f19-820f-c3b0d896a532 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:17.984135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d3062-ca2b-4f19-820f-c3b0d896a532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:17.984409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d3062-ca2b-4f19-820f-c3b0d896a532 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:17.985790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d3062-ca2b-4f19-820f-c3b0d896a532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:17.986149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d3062-ca2b-4f19-820f-c3b0d896a532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:17.987899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d3062-ca2b-4f19-820f-c3b0d896a532 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.001705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 969/1940] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:17 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:18.005797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acac8f1-6273-44a6-8cf5-c7555f034fe9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.018917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 972/1941] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:18.029569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d3062-ca2b-4f19-820f-c3b0d896a532 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.038767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acac8f1-6273-44a6-8cf5-c7555f034fe9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:18.049049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d3062-ca2b-4f19-820f-c3b0d896a532 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:18.056045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbbe2-7776-46eb-b806-4893ea93c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:18.056729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbbe2-7776-46eb-b806-4893ea93c6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.057421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbbe2-7776-46eb-b806-4893ea93c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.058297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbbe2-7776-46eb-b806-4893ea93c6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.062804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bbbe2-7776-46eb-b806-4893ea93c6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:18.062804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bbbe2-7776-46eb-b806-4893ea93c6c6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.067008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5c1f-deff-4faa-ae6a-81554f7587a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:18.068417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5c1f-deff-4faa-ae6a-81554f7587a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.070289 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5c1f-deff-4faa-ae6a-81554f7587a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.070825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5c1f-deff-4faa-ae6a-81554f7587a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.072631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f5c1f-deff-4faa-ae6a-81554f7587a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:18.081457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f5c1f-deff-4faa-ae6a-81554f7587a3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.092790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 970/1942] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:18.096410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbbe2-7776-46eb-b806-4893ea93c6c6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.112548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbbe2-7776-46eb-b806-4893ea93c6c6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:18.120882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a9d99-b35e-4d4f-951d-27c9c9a2fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:18.121204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a9d99-b35e-4d4f-951d-27c9c9a2fb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.121487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a9d99-b35e-4d4f-951d-27c9c9a2fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.121760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a9d99-b35e-4d4f-951d-27c9c9a2fb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.122557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a9d99-b35e-4d4f-951d-27c9c9a2fb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:18.124443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a9d99-b35e-4d4f-951d-27c9c9a2fb5b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.148829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 973/1943] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:18 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:18.151895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5c1f-deff-4faa-ae6a-81554f7587a3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.165017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 971/1944] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:18.167086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a9d99-b35e-4d4f-951d-27c9c9a2fb5b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.196068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a9d99-b35e-4d4f-951d-27c9c9a2fb5b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:18.277757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5c1f-deff-4faa-ae6a-81554f7587a3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:18.297018 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08a49-6d56-4698-86f0-de7f45ee9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:18.297859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08a49-6d56-4698-86f0-de7f45ee9a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.298045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08a49-6d56-4698-86f0-de7f45ee9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.298321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08a49-6d56-4698-86f0-de7f45ee9a92 admin admin] PATH_INFO: `/v3/projects/5588c5517e034ebabf5f72df21c77cfc/users/bc929690a6a5410cbec9853b47231fa6/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.325916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb08a49-6d56-4698-86f0-de7f45ee9a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5588c5517e034ebabf5f72df21c77cfc, user_id=bc929690a6a5410cbec9853b47231fa6, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:18.335013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a802b-b2ee-4515-b077-a905554e094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:18.335788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a802b-b2ee-4515-b077-a905554e094e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.336072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a802b-b2ee-4515-b077-a905554e094e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.336347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a802b-b2ee-4515-b077-a905554e094e admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.337810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a802b-b2ee-4515-b077-a905554e094e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:18.337997 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb08a49-6d56-4698-86f0-de7f45ee9a92 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.340637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a802b-b2ee-4515-b077-a905554e094e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.374388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 974/1945] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:18 2022] PUT /identity/v3/projects/5588c5517e034ebabf5f72df21c77cfc/users/bc929690a6a5410cbec9853b47231fa6/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:18.377219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8bd3-2d4c-4743-bd17-6eab46acd6dd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.377506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8bd3-2d4c-4743-bd17-6eab46acd6dd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.377837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf8bd3-2d4c-4743-bd17-6eab46acd6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.379574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 972/1946] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:18 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:18.383749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a802b-b2ee-4515-b077-a905554e094e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.414573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a802b-b2ee-4515-b077-a905554e094e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:18.448687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-96bf8bd3-2d4c-4743-bd17-6eab46acd6dd None None] MFA Rules not processed for user `bc929690a6a5410cbec9853b47231fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:18.452066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-96bf8bd3-2d4c-4743-bd17-6eab46acd6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:18.562243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ffd8-0dd7-428a-b46a-c373e9b68b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:18.563118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ffd8-0dd7-428a-b46a-c373e9b68b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.563399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ffd8-0dd7-428a-b46a-c373e9b68b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.563717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ffd8-0dd7-428a-b46a-c373e9b68b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.564604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4ffd8-0dd7-428a-b46a-c373e9b68b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:18.567814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4ffd8-0dd7-428a-b46a-c373e9b68b0d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.576163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:18.594603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 973/1947] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:18.595737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ffd8-0dd7-428a-b46a-c373e9b68b0d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.610823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 975/1948] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:18.615674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ffd8-0dd7-428a-b46a-c373e9b68b0d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:18.617124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8bd3-2d4c-4743-bd17-6eab46acd6dd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.621884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ca8fb-77e6-4caf-9c69-3a0df1476272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:18.623125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ca8fb-77e6-4caf-9c69-3a0df1476272 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.623428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ca8fb-77e6-4caf-9c69-3a0df1476272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.623824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ca8fb-77e6-4caf-9c69-3a0df1476272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.624689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ca8fb-77e6-4caf-9c69-3a0df1476272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:18.630265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ca8fb-77e6-4caf-9c69-3a0df1476272 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.632497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf8bd3-2d4c-4743-bd17-6eab46acd6dd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:18.634863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:18.640102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206945d-c270-4f70-b68a-97354a8c4071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:18.641588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206945d-c270-4f70-b68a-97354a8c4071 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.642076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206945d-c270-4f70-b68a-97354a8c4071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.643476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206945d-c270-4f70-b68a-97354a8c4071 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.644691 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206945d-c270-4f70-b68a-97354a8c4071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:18.647833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206945d-c270-4f70-b68a-97354a8c4071 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.653856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 974/1949] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:18.658662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ca8fb-77e6-4caf-9c69-3a0df1476272 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.682206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ca8fb-77e6-4caf-9c69-3a0df1476272 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:18.689396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a3fdc-eb52-42ae-8534-d7273ee46eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:18.690629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a3fdc-eb52-42ae-8534-d7273ee46eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.691175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a3fdc-eb52-42ae-8534-d7273ee46eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.691670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a3fdc-eb52-42ae-8534-d7273ee46eaf admin admin] PATH_INFO: `/v3/projects/7be3a588335846f080a393b42df46643/users/d7fa6ed036cf43da942d5e9ae328706c/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.730031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 976/1950] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:18 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:18.738824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206945d-c270-4f70-b68a-97354a8c4071 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:18.746269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a3fdc-eb52-42ae-8534-d7273ee46eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be3a588335846f080a393b42df46643, user_id=d7fa6ed036cf43da942d5e9ae328706c, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:18.752448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a3fdc-eb52-42ae-8534-d7273ee46eaf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:18.783429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 975/1951] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:18 2022] PUT /identity/v3/projects/7be3a588335846f080a393b42df46643/users/d7fa6ed036cf43da942d5e9ae328706c/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:18.809640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ce646-e720-4149-956b-9a31696e2d1d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:18.810578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ce646-e720-4149-956b-9a31696e2d1d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:18.811921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ce646-e720-4149-956b-9a31696e2d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:18.886672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3f8ce646-e720-4149-956b-9a31696e2d1d None None] MFA Rules not processed for user `d7fa6ed036cf43da942d5e9ae328706c`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:18.888418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3f8ce646-e720-4149-956b-9a31696e2d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:18.895301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206945d-c270-4f70-b68a-97354a8c4071 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.061932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbb013-91c0-487a-8820-25683b2293af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.063020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb013-91c0-487a-8820-25683b2293af admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.063368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb013-91c0-487a-8820-25683b2293af admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.063815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb013-91c0-487a-8820-25683b2293af admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.064512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbb013-91c0-487a-8820-25683b2293af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.066951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 976/1952] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:19.067943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbb013-91c0-487a-8820-25683b2293af admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.069465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2c9f1-ca23-4694-a873-bb7a5cc514e4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.069937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2c9f1-ca23-4694-a873-bb7a5cc514e4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.070384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2c9f1-ca23-4694-a873-bb7a5cc514e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.109195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 977/1953] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:18 2022] POST /identity/v3/users => generated 293 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:19.109616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b5c2c9f1-ca23-4694-a873-bb7a5cc514e4 None None] MFA Rules not processed for user `c8d51abc5ed741bab312fe7e68d1bcd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:19.110848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b5c2c9f1-ca23-4694-a873-bb7a5cc514e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:19.111235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbb013-91c0-487a-8820-25683b2293af admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.129751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbb013-91c0-487a-8820-25683b2293af admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.135386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8e260-af00-4433-b1f7-d9a303311ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.136107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8e260-af00-4433-b1f7-d9a303311ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.136486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8e260-af00-4433-b1f7-d9a303311ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.136829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8e260-af00-4433-b1f7-d9a303311ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.137792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8e260-af00-4433-b1f7-d9a303311ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.140105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8e260-af00-4433-b1f7-d9a303311ff6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.184118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 978/1954] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:19 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:19.185168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8e260-af00-4433-b1f7-d9a303311ff6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.242509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 977/1955] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:19.243754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2c9f1-ca23-4694-a873-bb7a5cc514e4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.261123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2c9f1-ca23-4694-a873-bb7a5cc514e4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.278700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:19.311294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8e260-af00-4433-b1f7-d9a303311ff6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.317910 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6cbc6-7e7c-497e-942d-88962ca3c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.318632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cbc6-7e7c-497e-942d-88962ca3c93f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.318915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cbc6-7e7c-497e-942d-88962ca3c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.319223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cbc6-7e7c-497e-942d-88962ca3c93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.320612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6cbc6-7e7c-497e-942d-88962ca3c93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.323068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6cbc6-7e7c-497e-942d-88962ca3c93f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.339582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 979/1956] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:19.341388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee33bd2-8af3-4af1-a7d8-e5e0390c00e8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.341876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee33bd2-8af3-4af1-a7d8-e5e0390c00e8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.342242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee33bd2-8af3-4af1-a7d8-e5e0390c00e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.348810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:19.372587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0ee33bd2-8af3-4af1-a7d8-e5e0390c00e8 None None] MFA Rules not processed for user `1082a31368be4f61b329a5f6f435b564`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:19.374093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0ee33bd2-8af3-4af1-a7d8-e5e0390c00e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:19.379803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6d620-e049-459d-8907-caa1fb7ac52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.380793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6d620-e049-459d-8907-caa1fb7ac52a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.381263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6d620-e049-459d-8907-caa1fb7ac52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.381714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6d620-e049-459d-8907-caa1fb7ac52a admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.383071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6d620-e049-459d-8907-caa1fb7ac52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.386443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6d620-e049-459d-8907-caa1fb7ac52a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.417809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 978/1957] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:19 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:19.418936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6d620-e049-459d-8907-caa1fb7ac52a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.429645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6d620-e049-459d-8907-caa1fb7ac52a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.435796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714d0d9-d1fc-4333-8d5b-5b0e6fcc9838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.436643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d0d9-d1fc-4333-8d5b-5b0e6fcc9838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.436994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d0d9-d1fc-4333-8d5b-5b0e6fcc9838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.437341 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d0d9-d1fc-4333-8d5b-5b0e6fcc9838 admin admin] PATH_INFO: `/v3/projects/c643af0140794687aaa87b4b0c3dd60a/users/33e5812b395f4229a742faa27293c435/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.451469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 980/1958] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:19.452372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee33bd2-8af3-4af1-a7d8-e5e0390c00e8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.456428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714d0d9-d1fc-4333-8d5b-5b0e6fcc9838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c643af0140794687aaa87b4b0c3dd60a, user_id=33e5812b395f4229a742faa27293c435, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.459413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714d0d9-d1fc-4333-8d5b-5b0e6fcc9838 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.467138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee33bd2-8af3-4af1-a7d8-e5e0390c00e8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.473510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691756-7bf5-4433-8271-8c1569ff596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.474411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691756-7bf5-4433-8271-8c1569ff596a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.474748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691756-7bf5-4433-8271-8c1569ff596a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.475157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691756-7bf5-4433-8271-8c1569ff596a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.476007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c691756-7bf5-4433-8271-8c1569ff596a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.476655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 979/1959] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:19 2022] PUT /identity/v3/projects/c643af0140794687aaa87b4b0c3dd60a/users/33e5812b395f4229a742faa27293c435/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:19.477565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714d0d9-d1fc-4333-8d5b-5b0e6fcc9838 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.477776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c691756-7bf5-4433-8271-8c1569ff596a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.481561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9714d0d9-d1fc-4333-8d5b-5b0e6fcc9838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:19.488796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 981/1960] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:19.489482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691756-7bf5-4433-8271-8c1569ff596a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.500615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691756-7bf5-4433-8271-8c1569ff596a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.568731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd68014-7405-478d-ab52-2804578771bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.569644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd68014-7405-478d-ab52-2804578771bb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.570128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd68014-7405-478d-ab52-2804578771bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.570312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714d0d9-d1fc-4333-8d5b-5b0e6fcc9838 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.570753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd68014-7405-478d-ab52-2804578771bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.571768 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd68014-7405-478d-ab52-2804578771bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.573566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd68014-7405-478d-ab52-2804578771bb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.576157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183adbae-d8d9-4eda-8526-2a3c519e8ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.576784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183adbae-d8d9-4eda-8526-2a3c519e8ac5 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.577076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183adbae-d8d9-4eda-8526-2a3c519e8ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.577349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183adbae-d8d9-4eda-8526-2a3c519e8ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.579149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-183adbae-d8d9-4eda-8526-2a3c519e8ac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:19.591381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 982/1961] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:19.591381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd68014-7405-478d-ab52-2804578771bb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.605723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd68014-7405-478d-ab52-2804578771bb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.611872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3358044-224c-475f-8c77-d51e30f1515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.612643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3358044-224c-475f-8c77-d51e30f1515d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.612995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3358044-224c-475f-8c77-d51e30f1515d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.613274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3358044-224c-475f-8c77-d51e30f1515d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.613974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3358044-224c-475f-8c77-d51e30f1515d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.616277 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3358044-224c-475f-8c77-d51e30f1515d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.631771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 983/1962] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:19.636308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3358044-224c-475f-8c77-d51e30f1515d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.655745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3358044-224c-475f-8c77-d51e30f1515d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.664045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb39d84-44c7-4904-a03a-c751327bafb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.665503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39d84-44c7-4904-a03a-c751327bafb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.665826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39d84-44c7-4904-a03a-c751327bafb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.666105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39d84-44c7-4904-a03a-c751327bafb8 admin admin] PATH_INFO: `/v3/projects/c643af0140794687aaa87b4b0c3dd60a/users/33e5812b395f4229a742faa27293c435/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.669842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb39d84-44c7-4904-a03a-c751327bafb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c643af0140794687aaa87b4b0c3dd60a, user_id=33e5812b395f4229a742faa27293c435, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.670778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183adbae-d8d9-4eda-8526-2a3c519e8ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.672636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb39d84-44c7-4904-a03a-c751327bafb8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.673645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183adbae-d8d9-4eda-8526-2a3c519e8ac5 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.686374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 984/1964] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:19 2022] PUT /identity/v3/projects/c643af0140794687aaa87b4b0c3dd60a/users/33e5812b395f4229a742faa27293c435/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:19.691182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb39d84-44c7-4904-a03a-c751327bafb8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.691411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 980/1964] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:19.701065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc1b6e-1868-4c8d-8899-bf5561478a3e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.701065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc1b6e-1868-4c8d-8899-bf5561478a3e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.701065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc1b6e-1868-4c8d-8899-bf5561478a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.738931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-16dc1b6e-1868-4c8d-8899-bf5561478a3e None None] MFA Rules not processed for user `33e5812b395f4229a742faa27293c435`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:19.742161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-16dc1b6e-1868-4c8d-8899-bf5561478a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:19.785726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:19.812841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb39d84-44c7-4904-a03a-c751327bafb8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:19.820486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172fc31-01a5-47f6-b214-dbd37e0610ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:19.822197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172fc31-01a5-47f6-b214-dbd37e0610ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.822512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172fc31-01a5-47f6-b214-dbd37e0610ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.825366 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172fc31-01a5-47f6-b214-dbd37e0610ae admin admin] PATH_INFO: `/v3/projects/0367889be65f4d6089b8a90d92aa92f2/users/96f1f632c0914b7cba818548f7ccd438/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.853414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172fc31-01a5-47f6-b214-dbd37e0610ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0367889be65f4d6089b8a90d92aa92f2, user_id=96f1f632c0914b7cba818548f7ccd438, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:19.856896 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172fc31-01a5-47f6-b214-dbd37e0610ae admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:19.858048 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:19.883299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 985/1965] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:19 2022] PUT /identity/v3/projects/0367889be65f4d6089b8a90d92aa92f2/users/96f1f632c0914b7cba818548f7ccd438/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:19.893598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101bde-115f-4af0-b2a1-2d2952ae49ca None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:19.893844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101bde-115f-4af0-b2a1-2d2952ae49ca None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:19.894123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101bde-115f-4af0-b2a1-2d2952ae49ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:19.914432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 981/1966] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:19.932239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc1b6e-1868-4c8d-8899-bf5561478a3e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:19.932635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-16dc1b6e-1868-4c8d-8899-bf5561478a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:19.937436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3a101bde-115f-4af0-b2a1-2d2952ae49ca None None] MFA Rules not processed for user `96f1f632c0914b7cba818548f7ccd438`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:19.938709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3a101bde-115f-4af0-b2a1-2d2952ae49ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:20.046554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc1b6e-1868-4c8d-8899-bf5561478a3e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:20.091368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 986/1967] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:20.092351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101bde-115f-4af0-b2a1-2d2952ae49ca None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:20.147221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac970-12f0-42ef-a504-8158b36b5340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:20.148708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac970-12f0-42ef-a504-8158b36b5340 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:20.149136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac970-12f0-42ef-a504-8158b36b5340 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:20.149774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac970-12f0-42ef-a504-8158b36b5340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:20.199499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101bde-115f-4af0-b2a1-2d2952ae49ca None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:20.199499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570849-1d39-470c-a567-016923963728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:20.200465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570849-1d39-470c-a567-016923963728 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:20.200788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570849-1d39-470c-a567-016923963728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:20.201069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3570849-1d39-470c-a567-016923963728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:20.201931 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3570849-1d39-470c-a567-016923963728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:20.204214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3570849-1d39-470c-a567-016923963728 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:20.232440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ac970-12f0-42ef-a504-8158b36b5340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:20.233905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ac970-12f0-42ef-a504-8158b36b5340 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:20.245434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 987/1968] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:20 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:20.246511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 982/1969] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:20.246827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570849-1d39-470c-a567-016923963728 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:20.307576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:20.324352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3570849-1d39-470c-a567-016923963728 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:20.330546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c29fb-a562-47a5-840f-f07906302ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:20.331312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c29fb-a562-47a5-840f-f07906302ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:20.331660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c29fb-a562-47a5-840f-f07906302ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:20.332134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c29fb-a562-47a5-840f-f07906302ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:20.333381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c29fb-a562-47a5-840f-f07906302ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:20.335363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c29fb-a562-47a5-840f-f07906302ad4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:20.368707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 988/1970] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:20 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:20.370378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac970-12f0-42ef-a504-8158b36b5340 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:20.394446 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac970-12f0-42ef-a504-8158b36b5340 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:20.405445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc360461-931b-4c46-9e7f-537073d93abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:20.407184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc360461-931b-4c46-9e7f-537073d93abf admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:20.407523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc360461-931b-4c46-9e7f-537073d93abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:20.407927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc360461-931b-4c46-9e7f-537073d93abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:20.410535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc360461-931b-4c46-9e7f-537073d93abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:20.413197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc360461-931b-4c46-9e7f-537073d93abf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:20.431039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 983/1971] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:20.434837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c29fb-a562-47a5-840f-f07906302ad4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:20.449705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c29fb-a562-47a5-840f-f07906302ad4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:20.472887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aff0b4-c56b-4032-9e0f-7c7aa05662ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:20.474239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aff0b4-c56b-4032-9e0f-7c7aa05662ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:20.474588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aff0b4-c56b-4032-9e0f-7c7aa05662ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:20.474867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aff0b4-c56b-4032-9e0f-7c7aa05662ad admin admin] PATH_INFO: `/v3/projects/edaaab2b6d804b94b57e11486db78254/users/06c29c2153c0449f9c032330d0456fea/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:20.510757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aff0b4-c56b-4032-9e0f-7c7aa05662ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=edaaab2b6d804b94b57e11486db78254, user_id=06c29c2153c0449f9c032330d0456fea, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:20.514338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aff0b4-c56b-4032-9e0f-7c7aa05662ad admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:20.542895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 989/1972] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:20 2022] PUT /identity/v3/projects/edaaab2b6d804b94b57e11486db78254/users/06c29c2153c0449f9c032330d0456fea/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:20.547677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc360461-931b-4c46-9e7f-537073d93abf admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:20.564166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc360461-931b-4c46-9e7f-537073d93abf admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:20.651979 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:20.689305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f3bba-167e-4a32-8981-cc9d5d9ccb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:20.690160 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f3bba-167e-4a32-8981-cc9d5d9ccb37 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:20.690464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f3bba-167e-4a32-8981-cc9d5d9ccb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:20.690792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f3bba-167e-4a32-8981-cc9d5d9ccb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:20.691851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f3bba-167e-4a32-8981-cc9d5d9ccb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:20.693830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f3bba-167e-4a32-8981-cc9d5d9ccb37 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:20.709699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 984/1973] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:20.711177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aff0b4-c56b-4032-9e0f-7c7aa05662ad admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:20.726253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aff0b4-c56b-4032-9e0f-7c7aa05662ad admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:20.733542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bf4d9-de92-4f6f-becc-a066a1557383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:20.735073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bf4d9-de92-4f6f-becc-a066a1557383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:20.735487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bf4d9-de92-4f6f-becc-a066a1557383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:20.735735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bf4d9-de92-4f6f-becc-a066a1557383 admin admin] PATH_INFO: `/v3/projects/edaaab2b6d804b94b57e11486db78254/users/06c29c2153c0449f9c032330d0456fea/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:20.738757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bf4d9-de92-4f6f-becc-a066a1557383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edaaab2b6d804b94b57e11486db78254, user_id=06c29c2153c0449f9c032330d0456fea, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:20.743607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bf4d9-de92-4f6f-becc-a066a1557383 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:20.776624 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 990/1974] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:20 2022] PUT /identity/v3/projects/edaaab2b6d804b94b57e11486db78254/users/06c29c2153c0449f9c032330d0456fea/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:20.791499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42ad72-890c-4509-bc22-9e8e2852af1c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:20.791915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42ad72-890c-4509-bc22-9e8e2852af1c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:20.792096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42ad72-890c-4509-bc22-9e8e2852af1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:20.839221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4e42ad72-890c-4509-bc22-9e8e2852af1c None None] MFA Rules not processed for user `06c29c2153c0449f9c032330d0456fea`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:20.840963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4e42ad72-890c-4509-bc22-9e8e2852af1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:20.965607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 985/1975] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:20.980630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bf4d9-de92-4f6f-becc-a066a1557383 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:21.074568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bf4d9-de92-4f6f-becc-a066a1557383 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:21.087521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bac63-c39e-438b-ae8a-6596848a59d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:21.088366 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bac63-c39e-438b-ae8a-6596848a59d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:21.088819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bac63-c39e-438b-ae8a-6596848a59d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:21.089284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bac63-c39e-438b-ae8a-6596848a59d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:21.194861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bac63-c39e-438b-ae8a-6596848a59d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:21.195677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bac63-c39e-438b-ae8a-6596848a59d4 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:21.218178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 991/1976] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:23.361338 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42ad72-890c-4509-bc22-9e8e2852af1c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:23.433653 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bac63-c39e-438b-ae8a-6596848a59d4 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:23.452177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bac63-c39e-438b-ae8a-6596848a59d4 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:23.462448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ac825-59cd-41f4-9df0-7df438ccb81a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:23.463429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ac825-59cd-41f4-9df0-7df438ccb81a service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:23.465252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ac825-59cd-41f4-9df0-7df438ccb81a service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:23.466126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ac825-59cd-41f4-9df0-7df438ccb81a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:23.488558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42ad72-890c-4509-bc22-9e8e2852af1c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:23.496248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:23.497259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:23.497687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:23.498225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] PATH_INFO: `/v3/users/bc929690a6a5410cbec9853b47231fa6` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:23.499876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc929690a6a5410cbec9853b47231fa6)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:23.503396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:23.571513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc929690a6a5410cbec9853b47231fa6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:23.572877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc929690a6a5410cbec9853b47231fa6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:23.607690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:23.623376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc929690a6a5410cbec9853b47231fa6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:23.639765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:23.643931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc929690a6a5410cbec9853b47231fa6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:23.644754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-86053fc1-53dd-4ca4-861d-d47a114b1cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc929690a6a5410cbec9853b47231fa6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:23.660982 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ac825-59cd-41f4-9df0-7df438ccb81a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:23.663926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ac825-59cd-41f4-9df0-7df438ccb81a service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:23.684752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 986/1977] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:23 2022] DELETE /identity/v3/users/bc929690a6a5410cbec9853b47231fa6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:23.687302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce2da-d209-4371-bf11-a45d95a5b1e4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:23.687600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce2da-d209-4371-bf11-a45d95a5b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:23.687876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce2da-d209-4371-bf11-a45d95a5b1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:23.723909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 992/1978] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:23.739469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-facce2da-d209-4371-bf11-a45d95a5b1e4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:23.740971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-facce2da-d209-4371-bf11-a45d95a5b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:23.838704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 987/1979] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:23.885499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ac825-59cd-41f4-9df0-7df438ccb81a service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:23.888722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d13ac825-59cd-41f4-9df0-7df438ccb81a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:24.076748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ac825-59cd-41f4-9df0-7df438ccb81a service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:24.157010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f8559-1d2d-41ff-9db4-95c5f3b66243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:24.158915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8559-1d2d-41ff-9db4-95c5f3b66243 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:24.159437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8559-1d2d-41ff-9db4-95c5f3b66243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:24.159729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f8559-1d2d-41ff-9db4-95c5f3b66243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:24.188597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f8559-1d2d-41ff-9db4-95c5f3b66243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:24.194601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f8559-1d2d-41ff-9db4-95c5f3b66243 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:24.221612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 993/1980] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:25.116367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce2da-d209-4371-bf11-a45d95a5b1e4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:25.118293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-facce2da-d209-4371-bf11-a45d95a5b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:25.270886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce2da-d209-4371-bf11-a45d95a5b1e4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:25.280873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769487-de1e-4d00-b6f8-8fe5f0f061ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:25.281582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769487-de1e-4d00-b6f8-8fe5f0f061ad service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:25.281832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769487-de1e-4d00-b6f8-8fe5f0f061ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:25.282224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769487-de1e-4d00-b6f8-8fe5f0f061ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:25.287054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6a769487-de1e-4d00-b6f8-8fe5f0f061ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:25.383244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769487-de1e-4d00-b6f8-8fe5f0f061ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:25.383987 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769487-de1e-4d00-b6f8-8fe5f0f061ad service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:25.404562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 988/1981] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:25.812184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f8559-1d2d-41ff-9db4-95c5f3b66243 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:25.813714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-771f8559-1d2d-41ff-9db4-95c5f3b66243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:25.827499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f8559-1d2d-41ff-9db4-95c5f3b66243 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:25.836969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:25.837785 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:25.838047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:25.838552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] PATH_INFO: `/v3/projects/5588c5517e034ebabf5f72df21c77cfc` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:25.840284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5588c5517e034ebabf5f72df21c77cfc)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:25.842463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:25.906511 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5588c5517e034ebabf5f72df21c77cfc', 'request_id': 'req-e8125453-b2c3-4939-a2bc-20684da93ce0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:25.913295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5588c5517e034ebabf5f72df21c77cfc', 'request_id': 'req-e8125453-b2c3-4939-a2bc-20684da93ce0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:25.923107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5588c5517e034ebabf5f72df21c77cfc', 'request_id': 'req-e8125453-b2c3-4939-a2bc-20684da93ce0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:25.937266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] The token cache is being invalidate because project 5588c5517e034ebabf5f72df21c77cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:25.937577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:25.938232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:25.939813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 994/1982] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:25 2022] DELETE /identity/v3/projects/5588c5517e034ebabf5f72df21c77cfc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:25.945585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769487-de1e-4d00-b6f8-8fe5f0f061ad service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:25.956770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769487-de1e-4d00-b6f8-8fe5f0f061ad service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:25.990491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:26.034433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:26.035068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:26.035355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:26.035630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] PATH_INFO: `/v3/users/33e5812b395f4229a742faa27293c435` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:26.036952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e5812b395f4229a742faa27293c435)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:26.038953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:26.094385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e5812b395f4229a742faa27293c435'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:26.095166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e5812b395f4229a742faa27293c435'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:26.108223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e5812b395f4229a742faa27293c435'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:26.116836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e5812b395f4229a742faa27293c435'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:26.117559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2d0ac684-4f46-4374-926c-359911073d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e5812b395f4229a742faa27293c435'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:26.132257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 989/1983] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:25 2022] DELETE /identity/v3/users/33e5812b395f4229a742faa27293c435 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:26.959895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:26.961525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:26.994342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8125453-b2c3-4939-a2bc-20684da93ce0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:27.092974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:27.170204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:27.170948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:27.171867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:27.172291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] PATH_INFO: `/v3/projects/c643af0140794687aaa87b4b0c3dd60a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:27.176703 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c643af0140794687aaa87b4b0c3dd60a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:27.180083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:27.277709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c643af0140794687aaa87b4b0c3dd60a', 'request_id': 'req-26b09575-ed71-4950-a3da-33c4775f9cf5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:27.287503 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c643af0140794687aaa87b4b0c3dd60a', 'request_id': 'req-26b09575-ed71-4950-a3da-33c4775f9cf5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:27.300549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c643af0140794687aaa87b4b0c3dd60a', 'request_id': 'req-26b09575-ed71-4950-a3da-33c4775f9cf5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:27.318936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] The token cache is being invalidate because project c643af0140794687aaa87b4b0c3dd60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:27.320759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:27.322294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-26b09575-ed71-4950-a3da-33c4775f9cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:27.324916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 995/1984] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:26 2022] DELETE /identity/v3/projects/c643af0140794687aaa87b4b0c3dd60a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:27.330681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081a83-290c-46c8-8c83-16f122f8bf66 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:27.331633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081a83-290c-46c8-8c83-16f122f8bf66 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:27.332172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081a83-290c-46c8-8c83-16f122f8bf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:27.364381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-68081a83-290c-46c8-8c83-16f122f8bf66 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:27.366880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-68081a83-290c-46c8-8c83-16f122f8bf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:27.479826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 990/1985] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:27.489499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836a03-57c9-4267-8834-de9777800174 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:27.490394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836a03-57c9-4267-8834-de9777800174 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:27.491487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836a03-57c9-4267-8834-de9777800174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:27.542598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-67836a03-57c9-4267-8834-de9777800174 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:27.544255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-67836a03-57c9-4267-8834-de9777800174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:27.554715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 996/1986] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:27.558724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68081a83-290c-46c8-8c83-16f122f8bf66 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:27.568688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68081a83-290c-46c8-8c83-16f122f8bf66 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:27.573651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e291a91-8414-462f-8b0c-0f2f047b8289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:27.574444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291a91-8414-462f-8b0c-0f2f047b8289 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:27.574596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291a91-8414-462f-8b0c-0f2f047b8289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:27.574829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e291a91-8414-462f-8b0c-0f2f047b8289 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:27.575576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e291a91-8414-462f-8b0c-0f2f047b8289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:27.576137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e291a91-8414-462f-8b0c-0f2f047b8289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:27.578231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e291a91-8414-462f-8b0c-0f2f047b8289 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:27.596827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 991/1987] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:27.602835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67836a03-57c9-4267-8834-de9777800174 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:27.616469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67836a03-57c9-4267-8834-de9777800174 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:27.622123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa76f3c-3026-4209-a20e-82437b33e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:27.623096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa76f3c-3026-4209-a20e-82437b33e339 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:27.623389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa76f3c-3026-4209-a20e-82437b33e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:27.623679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa76f3c-3026-4209-a20e-82437b33e339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:27.624356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa76f3c-3026-4209-a20e-82437b33e339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:27.626473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa76f3c-3026-4209-a20e-82437b33e339 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:27.664828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 997/1988] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:27 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:27.669469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e291a91-8414-462f-8b0c-0f2f047b8289 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:27.691124 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e291a91-8414-462f-8b0c-0f2f047b8289 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:27.735089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:27.803477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a485d0e-2590-42ed-ae48-653c925e95bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:27.804411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a485d0e-2590-42ed-ae48-653c925e95bb admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:27.804840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a485d0e-2590-42ed-ae48-653c925e95bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:27.805315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a485d0e-2590-42ed-ae48-653c925e95bb admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:27.806214 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a485d0e-2590-42ed-ae48-653c925e95bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:27.809269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a485d0e-2590-42ed-ae48-653c925e95bb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:27.855657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 992/1989] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:27 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:27.859253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa76f3c-3026-4209-a20e-82437b33e339 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:27.873084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa76f3c-3026-4209-a20e-82437b33e339 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:27.879992 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26f20b-6e98-4eab-9ddd-43daf0f1223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:27.880845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f20b-6e98-4eab-9ddd-43daf0f1223d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:27.881269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f20b-6e98-4eab-9ddd-43daf0f1223d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:27.881685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f20b-6e98-4eab-9ddd-43daf0f1223d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:27.882538 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26f20b-6e98-4eab-9ddd-43daf0f1223d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:27.884445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26f20b-6e98-4eab-9ddd-43daf0f1223d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:27.900486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 998/1990] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:27.904311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a485d0e-2590-42ed-ae48-653c925e95bb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:27.916848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a485d0e-2590-42ed-ae48-653c925e95bb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:27.924893 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca035c-f42c-46f9-ade0-284372ecb319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:27.926764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca035c-f42c-46f9-ade0-284372ecb319 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:27.927183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca035c-f42c-46f9-ade0-284372ecb319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:27.927568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca035c-f42c-46f9-ade0-284372ecb319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:27.928770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca035c-f42c-46f9-ade0-284372ecb319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:27.932568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca035c-f42c-46f9-ade0-284372ecb319 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:27.948905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 993/1991] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:27.952991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26f20b-6e98-4eab-9ddd-43daf0f1223d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:27.963747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26f20b-6e98-4eab-9ddd-43daf0f1223d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:27.970307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f6f0-2075-4d7c-8972-530e272bd111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:27.971372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f6f0-2075-4d7c-8972-530e272bd111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:27.971804 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f6f0-2075-4d7c-8972-530e272bd111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:27.972226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f6f0-2075-4d7c-8972-530e272bd111 admin admin] PATH_INFO: `/v3/projects/ab96247f7ea843ad9189db13040755ab/users/e2c3d5efd51d4f348b4c50c4492ad3a0/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:27.995909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f6f0-2075-4d7c-8972-530e272bd111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab96247f7ea843ad9189db13040755ab, user_id=e2c3d5efd51d4f348b4c50c4492ad3a0, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:27.999684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f6f0-2075-4d7c-8972-530e272bd111 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:28.019726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 999/1992] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:27 2022] PUT /identity/v3/projects/ab96247f7ea843ad9189db13040755ab/users/e2c3d5efd51d4f348b4c50c4492ad3a0/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:28.038791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88340563-9c9c-4270-9305-51a9ce36c98d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:28.039343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88340563-9c9c-4270-9305-51a9ce36c98d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:28.039932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88340563-9c9c-4270-9305-51a9ce36c98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:28.103607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-88340563-9c9c-4270-9305-51a9ce36c98d None None] MFA Rules not processed for user `e2c3d5efd51d4f348b4c50c4492ad3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:28.105129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-88340563-9c9c-4270-9305-51a9ce36c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:28.235148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 994/1993] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:28.269908 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f6f0-2075-4d7c-8972-530e272bd111 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:28.276893 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-15f5f6f0-2075-4d7c-8972-530e272bd111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:28.451230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88340563-9c9c-4270-9305-51a9ce36c98d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:28.453284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-88340563-9c9c-4270-9305-51a9ce36c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:28.456000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f6f0-2075-4d7c-8972-530e272bd111 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:28.465125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47213e03-11f2-4a80-9e63-4a16d86a04b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:28.466263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47213e03-11f2-4a80-9e63-4a16d86a04b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:28.466836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47213e03-11f2-4a80-9e63-4a16d86a04b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:28.467330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47213e03-11f2-4a80-9e63-4a16d86a04b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:28.479865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47213e03-11f2-4a80-9e63-4a16d86a04b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:28.482843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47213e03-11f2-4a80-9e63-4a16d86a04b7 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:28.500889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1000/1994] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:28.662772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88340563-9c9c-4270-9305-51a9ce36c98d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:28.687520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:28.688651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:28.688963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:28.689286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] PATH_INFO: `/v3/users/362f56d066674ff5adaf5a4fca270e4a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:28.695083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=362f56d066674ff5adaf5a4fca270e4a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:28.704279 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:28.820427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:28.828960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362f56d066674ff5adaf5a4fca270e4a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:28.833748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362f56d066674ff5adaf5a4fca270e4a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:28.858494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362f56d066674ff5adaf5a4fca270e4a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:28.871378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362f56d066674ff5adaf5a4fca270e4a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:28.872823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362f56d066674ff5adaf5a4fca270e4a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:28.893792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 995/1995] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:28 2022] DELETE /identity/v3/users/362f56d066674ff5adaf5a4fca270e4a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:28.898848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a31845-5d3e-4aba-b90b-260fc56e6244 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:28.899158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a31845-5d3e-4aba-b90b-260fc56e6244 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:28.901475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a31845-5d3e-4aba-b90b-260fc56e6244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:28.936435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:29.017014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-16a31845-5d3e-4aba-b90b-260fc56e6244 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:29.021867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-16a31845-5d3e-4aba-b90b-260fc56e6244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:29.183664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1001/1996] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:29.194570 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:29.196516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:29.296919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7c79-22f8-45b8-81d7-608acd607adc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:29.301854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92d316-eecd-4255-80d7-136e083cd16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:29.302491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92d316-eecd-4255-80d7-136e083cd16c service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:29.302767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92d316-eecd-4255-80d7-136e083cd16c service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:29.303074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92d316-eecd-4255-80d7-136e083cd16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:29.314661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92d316-eecd-4255-80d7-136e083cd16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:29.316209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92d316-eecd-4255-80d7-136e083cd16c service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:29.329533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 996/1997] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:29.727727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a31845-5d3e-4aba-b90b-260fc56e6244 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:29.729252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-16a31845-5d3e-4aba-b90b-260fc56e6244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:29.748114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a31845-5d3e-4aba-b90b-260fc56e6244 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:29.759857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:29.760579 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:29.760864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:29.761126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] PATH_INFO: `/v3/projects/df1390b3c381490499f7f50a08ef2a92` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:29.763168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1390b3c381490499f7f50a08ef2a92)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:29.764441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:29.830826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1390b3c381490499f7f50a08ef2a92', 'request_id': 'req-fa21ddd7-1402-4773-b5bc-261bd42f99cc'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:29.837004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1390b3c381490499f7f50a08ef2a92', 'request_id': 'req-fa21ddd7-1402-4773-b5bc-261bd42f99cc'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:29.844663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1390b3c381490499f7f50a08ef2a92', 'request_id': 'req-fa21ddd7-1402-4773-b5bc-261bd42f99cc'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:29.856940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] The token cache is being invalidate because project df1390b3c381490499f7f50a08ef2a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:29.857258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:29.857914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:29.859551 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1002/1998] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:29 2022] DELETE /identity/v3/projects/df1390b3c381490499f7f50a08ef2a92 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:29.863959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92d316-eecd-4255-80d7-136e083cd16c service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:29.873862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92d316-eecd-4255-80d7-136e083cd16c service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:29.940398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:29.941055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:29.941335 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:29.941609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] PATH_INFO: `/v3/users/2338ac239bea4a84a20f11afa714d31f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:29.943372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2338ac239bea4a84a20f11afa714d31f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:29.945509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:29.998218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2338ac239bea4a84a20f11afa714d31f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:29.998930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2338ac239bea4a84a20f11afa714d31f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.022927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2338ac239bea4a84a20f11afa714d31f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.022927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:30.026703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2338ac239bea4a84a20f11afa714d31f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.027940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2338ac239bea4a84a20f11afa714d31f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.044192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 997/1999] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:29 2022] DELETE /identity/v3/users/2338ac239bea4a84a20f11afa714d31f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:30.454101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:30.456644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:30.469335 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:30.471768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:30.479072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21ddd7-1402-4773-b5bc-261bd42f99cc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:30.556049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:30.556700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:30.557538 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:30.558379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] PATH_INFO: `/v3/users/d7fa6ed036cf43da942d5e9ae328706c` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:30.560216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fa6ed036cf43da942d5e9ae328706c)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:30.562384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:30.571492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16124f-a17d-45f9-9b69-512f94a94a8b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:30.578208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:30.578788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:30.579268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:30.579373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] PATH_INFO: `/v3/projects/266007809ef747fbb87a9f28cd7d05c8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:30.580867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266007809ef747fbb87a9f28cd7d05c8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:30.584001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:30.635780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:30.649012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266007809ef747fbb87a9f28cd7d05c8', 'request_id': 'req-7d1dd567-751a-45b9-a021-21f55f8de984'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.656439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266007809ef747fbb87a9f28cd7d05c8', 'request_id': 'req-7d1dd567-751a-45b9-a021-21f55f8de984'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.657024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fa6ed036cf43da942d5e9ae328706c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.657740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fa6ed036cf43da942d5e9ae328706c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.668447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266007809ef747fbb87a9f28cd7d05c8', 'request_id': 'req-7d1dd567-751a-45b9-a021-21f55f8de984'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.674504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fa6ed036cf43da942d5e9ae328706c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.682583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fa6ed036cf43da942d5e9ae328706c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.685775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] The token cache is being invalidate because project 266007809ef747fbb87a9f28cd7d05c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:30.686058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.686745 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7d1dd567-751a-45b9-a021-21f55f8de984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.688838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 998/2000] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:30 2022] DELETE /identity/v3/projects/266007809ef747fbb87a9f28cd7d05c8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:30.693994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66005fb-2341-42b1-848e-dbf6beecd63b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:30.694435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66005fb-2341-42b1-848e-dbf6beecd63b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:30.694787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66005fb-2341-42b1-848e-dbf6beecd63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:30.696236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-5b91adf3-5456-4829-be23-ce067b7d31da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fa6ed036cf43da942d5e9ae328706c'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:30.703701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1003/2001] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:30 2022] DELETE /identity/v3/users/d7fa6ed036cf43da942d5e9ae328706c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:30.709462 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f159f-fb48-4ded-b57c-3db77cf8718d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:30.709893 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f159f-fb48-4ded-b57c-3db77cf8718d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:30.710166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f159f-fb48-4ded-b57c-3db77cf8718d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:30.721302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c66005fb-2341-42b1-848e-dbf6beecd63b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:30.722767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c66005fb-2341-42b1-848e-dbf6beecd63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:30.730607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-658f159f-fb48-4ded-b57c-3db77cf8718d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:30.735114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-658f159f-fb48-4ded-b57c-3db77cf8718d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:30.800240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 999/2002] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:30.809882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb761814-acc3-4040-bf0d-0066f62533f1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:30.810195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb761814-acc3-4040-bf0d-0066f62533f1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:30.810481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb761814-acc3-4040-bf0d-0066f62533f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:30.837695 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1004/2003] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:30.839632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cb761814-acc3-4040-bf0d-0066f62533f1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:30.841080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cb761814-acc3-4040-bf0d-0066f62533f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:30.847557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f159f-fb48-4ded-b57c-3db77cf8718d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:30.848328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-658f159f-fb48-4ded-b57c-3db77cf8718d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:30.866037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1000/2004] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:30.873403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb761814-acc3-4040-bf0d-0066f62533f1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:30.889841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb761814-acc3-4040-bf0d-0066f62533f1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:30.896731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74dba6-9a77-47eb-aed1-1c26876f37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:30.897731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74dba6-9a77-47eb-aed1-1c26876f37f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:30.898144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74dba6-9a77-47eb-aed1-1c26876f37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:30.898542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74dba6-9a77-47eb-aed1-1c26876f37f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:30.899296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74dba6-9a77-47eb-aed1-1c26876f37f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:30.899596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74dba6-9a77-47eb-aed1-1c26876f37f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:30.901771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74dba6-9a77-47eb-aed1-1c26876f37f3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:30.903702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:30.921389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1001/2005] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:30.928785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74dba6-9a77-47eb-aed1-1c26876f37f3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:30.935633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f159f-fb48-4ded-b57c-3db77cf8718d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:30.939336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cbe0c-1906-49f7-9142-68c37239f520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:30.939962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cbe0c-1906-49f7-9142-68c37239f520 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:30.940238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cbe0c-1906-49f7-9142-68c37239f520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:30.940588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cbe0c-1906-49f7-9142-68c37239f520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:30.949986 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74dba6-9a77-47eb-aed1-1c26876f37f3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:30.953039 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cbe0c-1906-49f7-9142-68c37239f520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:30.954484 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cbe0c-1906-49f7-9142-68c37239f520 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:30.962189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04bfc5-5d7e-42f3-b164-afa7a38fba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:30.962906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04bfc5-5d7e-42f3-b164-afa7a38fba70 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:30.963995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04bfc5-5d7e-42f3-b164-afa7a38fba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:30.964279 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04bfc5-5d7e-42f3-b164-afa7a38fba70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:30.965244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04bfc5-5d7e-42f3-b164-afa7a38fba70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:30.967952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04bfc5-5d7e-42f3-b164-afa7a38fba70 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:30.968230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1005/2006] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:31.004009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1002/2007] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:30 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:31.008541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cbe0c-1906-49f7-9142-68c37239f520 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.018852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cbe0c-1906-49f7-9142-68c37239f520 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.073256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:31.088283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc86fe0-4edd-4431-b68a-e9de38a311f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.089102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86fe0-4edd-4431-b68a-e9de38a311f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.089851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86fe0-4edd-4431-b68a-e9de38a311f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.090400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86fe0-4edd-4431-b68a-e9de38a311f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.091112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc86fe0-4edd-4431-b68a-e9de38a311f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.093437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc86fe0-4edd-4431-b68a-e9de38a311f2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.117690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1006/2008] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:31 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:31.124209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04bfc5-5d7e-42f3-b164-afa7a38fba70 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.150112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04bfc5-5d7e-42f3-b164-afa7a38fba70 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.155969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d876efe-8594-4a86-957e-41edaaedd02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.156667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d876efe-8594-4a86-957e-41edaaedd02b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.157055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d876efe-8594-4a86-957e-41edaaedd02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.157420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d876efe-8594-4a86-957e-41edaaedd02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.163157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d876efe-8594-4a86-957e-41edaaedd02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.165692 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d876efe-8594-4a86-957e-41edaaedd02b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.179047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1003/2009] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:31.182881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc86fe0-4edd-4431-b68a-e9de38a311f2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.193216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc86fe0-4edd-4431-b68a-e9de38a311f2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.197910 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98514f2-dbed-4736-a4c6-9af89bc8553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.198527 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98514f2-dbed-4736-a4c6-9af89bc8553a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.198805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98514f2-dbed-4736-a4c6-9af89bc8553a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.199109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98514f2-dbed-4736-a4c6-9af89bc8553a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.199919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98514f2-dbed-4736-a4c6-9af89bc8553a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.201547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98514f2-dbed-4736-a4c6-9af89bc8553a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.213242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1007/2010] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:31.217405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d876efe-8594-4a86-957e-41edaaedd02b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.228569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d876efe-8594-4a86-957e-41edaaedd02b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.233561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a9545-090c-455f-8f6b-ef8b7471c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.234233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a9545-090c-455f-8f6b-ef8b7471c7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.234522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a9545-090c-455f-8f6b-ef8b7471c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.234800 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a9545-090c-455f-8f6b-ef8b7471c7ca admin admin] PATH_INFO: `/v3/projects/96edba605880462bbd9cbc55c2beea03/users/e7fbb54a6ad940649e0e369932bbd39a/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.250935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a9545-090c-455f-8f6b-ef8b7471c7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=96edba605880462bbd9cbc55c2beea03, user_id=e7fbb54a6ad940649e0e369932bbd39a, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.253628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a9545-090c-455f-8f6b-ef8b7471c7ca admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.267668 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1004/2011] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:31 2022] PUT /identity/v3/projects/96edba605880462bbd9cbc55c2beea03/users/e7fbb54a6ad940649e0e369932bbd39a/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:31.279273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f04f76-b5a0-4175-92f0-c2ea797baead None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.279563 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f04f76-b5a0-4175-92f0-c2ea797baead None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.279867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f04f76-b5a0-4175-92f0-c2ea797baead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.311236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-49f04f76-b5a0-4175-92f0-c2ea797baead None None] MFA Rules not processed for user `e7fbb54a6ad940649e0e369932bbd39a`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:31.312469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-49f04f76-b5a0-4175-92f0-c2ea797baead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:31.438251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1008/2012] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:31.443372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a9545-090c-455f-8f6b-ef8b7471c7ca admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.516186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f04f76-b5a0-4175-92f0-c2ea797baead None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.518082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-49f04f76-b5a0-4175-92f0-c2ea797baead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:31.525304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a9545-090c-455f-8f6b-ef8b7471c7ca admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.530835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bbd33-b432-44dd-a14b-807355d2dd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.531513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bbd33-b432-44dd-a14b-807355d2dd0c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.531793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bbd33-b432-44dd-a14b-807355d2dd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.532067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bbd33-b432-44dd-a14b-807355d2dd0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.532775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bbd33-b432-44dd-a14b-807355d2dd0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.534828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bbd33-b432-44dd-a14b-807355d2dd0c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.536453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f04f76-b5a0-4175-92f0-c2ea797baead None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.542696 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.543611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.544069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.544489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] PATH_INFO: `/v3/projects/7be3a588335846f080a393b42df46643` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.546580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be3a588335846f080a393b42df46643)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.548995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.584426 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1005/2013] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:31 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:31.588183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bbd33-b432-44dd-a14b-807355d2dd0c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.638159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be3a588335846f080a393b42df46643', 'request_id': 'req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.648551 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be3a588335846f080a393b42df46643', 'request_id': 'req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.658015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be3a588335846f080a393b42df46643', 'request_id': 'req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.666883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bbd33-b432-44dd-a14b-807355d2dd0c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.672618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] The token cache is being invalidate because project 7be3a588335846f080a393b42df46643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:31.673092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.673924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.675811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1009/2014] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:31 2022] DELETE /identity/v3/projects/7be3a588335846f080a393b42df46643 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:31.679365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.680854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:31.702142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:31.737809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:31.745118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ad914-fcfd-47c3-ba7e-a9fcb2171912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.746311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ad914-fcfd-47c3-ba7e-a9fcb2171912 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.746632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ad914-fcfd-47c3-ba7e-a9fcb2171912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.747191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ad914-fcfd-47c3-ba7e-a9fcb2171912 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.747882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ad914-fcfd-47c3-ba7e-a9fcb2171912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.750247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ad914-fcfd-47c3-ba7e-a9fcb2171912 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.775528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1d596-f2c0-47fa-b044-1e4d3c68a13f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.779022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1006/2015] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:31 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:31.780651 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.781578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.781946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.782268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] PATH_INFO: `/v3/users/96f1f632c0914b7cba818548f7ccd438` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.782375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ad914-fcfd-47c3-ba7e-a9fcb2171912 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.783562 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f1f632c0914b7cba818548f7ccd438)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.784753 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-660ad914-fcfd-47c3-ba7e-a9fcb2171912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:31.785678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.799720 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ad914-fcfd-47c3-ba7e-a9fcb2171912 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.807333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b441c-3b98-4334-9a27-3c7d86c55217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.808078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b441c-3b98-4334-9a27-3c7d86c55217 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.808563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b441c-3b98-4334-9a27-3c7d86c55217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.808915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b441c-3b98-4334-9a27-3c7d86c55217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.809691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b441c-3b98-4334-9a27-3c7d86c55217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.813288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b441c-3b98-4334-9a27-3c7d86c55217 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.827382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1007/2016] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:31.832012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b441c-3b98-4334-9a27-3c7d86c55217 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.844397 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b441c-3b98-4334-9a27-3c7d86c55217 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:31.849695 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f1f632c0914b7cba818548f7ccd438'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.850123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f16735-0797-48cb-8e24-b1e6ff760d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:31.850799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f16735-0797-48cb-8e24-b1e6ff760d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:31.851076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f1f632c0914b7cba818548f7ccd438'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.851192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f16735-0797-48cb-8e24-b1e6ff760d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:31.851374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f16735-0797-48cb-8e24-b1e6ff760d4b admin admin] PATH_INFO: `/v3/projects/74e98c84e4294442a60d9127e1e1a1c1/users/262ffe5887704b37bc8851ee9ce5f94b/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:31.868874 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f1f632c0914b7cba818548f7ccd438'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.870452 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f16735-0797-48cb-8e24-b1e6ff760d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e98c84e4294442a60d9127e1e1a1c1, user_id=262ffe5887704b37bc8851ee9ce5f94b, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:31.873186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f16735-0797-48cb-8e24-b1e6ff760d4b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:31.882682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f1f632c0914b7cba818548f7ccd438'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.889766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1008/2017] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:31 2022] PUT /identity/v3/projects/74e98c84e4294442a60d9127e1e1a1c1/users/262ffe5887704b37bc8851ee9ce5f94b/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:31.894573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f1f632c0914b7cba818548f7ccd438'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:31.894719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f16735-0797-48cb-8e24-b1e6ff760d4b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:31.896654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b8f16735-0797-48cb-8e24-b1e6ff760d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:31.901317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1010/2018] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:31 2022] DELETE /identity/v3/users/96f1f632c0914b7cba818548f7ccd438 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:31.981140 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f16735-0797-48cb-8e24-b1e6ff760d4b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:32.020199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:32.022175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:32.102303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77033-9604-4efd-af4c-c131741a6356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:32.103203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77033-9604-4efd-af4c-c131741a6356 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:32.103577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77033-9604-4efd-af4c-c131741a6356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:32.103917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77033-9604-4efd-af4c-c131741a6356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:32.104962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77033-9604-4efd-af4c-c131741a6356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:32.107149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77033-9604-4efd-af4c-c131741a6356 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:32.124736 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1009/2019] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:32.126186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77033-9604-4efd-af4c-c131741a6356 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:32.131777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d95aa-0072-476c-a942-b6948cf79298 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:32.138052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:32.139158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:32.139636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:32.140122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] PATH_INFO: `/v3/users/e2c3d5efd51d4f348b4c50c4492ad3a0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:32.140844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77033-9604-4efd-af4c-c131741a6356 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:32.142239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c3d5efd51d4f348b4c50c4492ad3a0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:32.144630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:32.148453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c9a2c-3a34-4000-9dd4-5b06a308b796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:32.149288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9a2c-3a34-4000-9dd4-5b06a308b796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:32.149572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9a2c-3a34-4000-9dd4-5b06a308b796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:32.149994 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c9a2c-3a34-4000-9dd4-5b06a308b796 admin admin] PATH_INFO: `/v3/projects/74e98c84e4294442a60d9127e1e1a1c1/users/262ffe5887704b37bc8851ee9ce5f94b/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:32.152752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c9a2c-3a34-4000-9dd4-5b06a308b796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e98c84e4294442a60d9127e1e1a1c1, user_id=262ffe5887704b37bc8851ee9ce5f94b, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:32.156491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c9a2c-3a34-4000-9dd4-5b06a308b796 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:32.172284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1010/2020] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:32 2022] PUT /identity/v3/projects/74e98c84e4294442a60d9127e1e1a1c1/users/262ffe5887704b37bc8851ee9ce5f94b/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:32.186531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5baeb6-cf86-41b5-9485-8a7ac79eee55 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:32.186628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5baeb6-cf86-41b5-9485-8a7ac79eee55 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:32.187445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5baeb6-cf86-41b5-9485-8a7ac79eee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:32.217361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c3d5efd51d4f348b4c50c4492ad3a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.218008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c3d5efd51d4f348b4c50c4492ad3a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.233744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:32.235864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:32.240900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0a5baeb6-cf86-41b5-9485-8a7ac79eee55 None None] MFA Rules not processed for user `262ffe5887704b37bc8851ee9ce5f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:32.243714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0a5baeb6-cf86-41b5-9485-8a7ac79eee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:32.243869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c3d5efd51d4f348b4c50c4492ad3a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.253700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c3d5efd51d4f348b4c50c4492ad3a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.263245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15386272-99be-4b28-a11e-2c4b8a185c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c3d5efd51d4f348b4c50c4492ad3a0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.272282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1011/2021] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:32 2022] DELETE /identity/v3/users/e2c3d5efd51d4f348b4c50c4492ad3a0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:32.276912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78481b3-2f35-45ef-9b46-b12d31d49457 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:32.277194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78481b3-2f35-45ef-9b46-b12d31d49457 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:32.277467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78481b3-2f35-45ef-9b46-b12d31d49457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:32.309887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d78481b3-2f35-45ef-9b46-b12d31d49457 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:32.311927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d78481b3-2f35-45ef-9b46-b12d31d49457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:32.338333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1011/2022] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:32.365490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5baeb6-cf86-41b5-9485-8a7ac79eee55 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:32.367522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0a5baeb6-cf86-41b5-9485-8a7ac79eee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:32.427274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1012/2023] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:32.428485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78481b3-2f35-45ef-9b46-b12d31d49457 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:32.430050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d78481b3-2f35-45ef-9b46-b12d31d49457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:32.446143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78481b3-2f35-45ef-9b46-b12d31d49457 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:32.453472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:32.454155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:32.454928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:32.454928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] PATH_INFO: `/v3/projects/0367889be65f4d6089b8a90d92aa92f2` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:32.457112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0367889be65f4d6089b8a90d92aa92f2)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:32.460023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:32.472334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5baeb6-cf86-41b5-9485-8a7ac79eee55 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:32.522901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0367889be65f4d6089b8a90d92aa92f2', 'request_id': 'req-4471b545-c546-473d-9100-cf2ff8d125c2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.528655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0367889be65f4d6089b8a90d92aa92f2', 'request_id': 'req-4471b545-c546-473d-9100-cf2ff8d125c2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.529655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b159-e863-4330-809c-db1bdb219ddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:32.530362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b159-e863-4330-809c-db1bdb219ddb service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:32.530821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b159-e863-4330-809c-db1bdb219ddb service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:32.531204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b159-e863-4330-809c-db1bdb219ddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:32.537114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0367889be65f4d6089b8a90d92aa92f2', 'request_id': 'req-4471b545-c546-473d-9100-cf2ff8d125c2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.553420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] The token cache is being invalidate because project 0367889be65f4d6089b8a90d92aa92f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:32.553718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.554389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.556054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1013/2024] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:32 2022] DELETE /identity/v3/projects/0367889be65f4d6089b8a90d92aa92f2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:32.556983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:32.559775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:32.603435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570b159-e863-4330-809c-db1bdb219ddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:32.605199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570b159-e863-4330-809c-db1bdb219ddb service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:32.623290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1012/2025] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:32.624145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b159-e863-4330-809c-db1bdb219ddb service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:32.624514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471b545-c546-473d-9100-cf2ff8d125c2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:32.628626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:32.630018 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:32.630169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:32.630441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:32.632365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:32.633198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:32.637884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b159-e863-4330-809c-db1bdb219ddb service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:32.657003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:32.737082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:32.737886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:32.739029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:32.739488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] PATH_INFO: `/v3/users/06c29c2153c0449f9c032330d0456fea` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:32.740930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c29c2153c0449f9c032330d0456fea)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:32.743908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:32.763184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:32.764985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:32.778332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1014/2026] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:32.779335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:32.780810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:32.812591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c29c2153c0449f9c032330d0456fea'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.813409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c29c2153c0449f9c032330d0456fea'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.833774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c29c2153c0449f9c032330d0456fea'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.844911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c29c2153c0449f9c032330d0456fea'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.846027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c29c2153c0449f9c032330d0456fea'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:32.862779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1013/2027] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:32 2022] DELETE /identity/v3/users/06c29c2153c0449f9c032330d0456fea => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:32.895508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65ba02-a1d2-4252-b362-942c78e4cede service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:33.037511 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021250c8-ea8f-4020-98d7-e22519358792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:33.038154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021250c8-ea8f-4020-98d7-e22519358792 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:33.038439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021250c8-ea8f-4020-98d7-e22519358792 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:33.038714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021250c8-ea8f-4020-98d7-e22519358792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:33.044719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-021250c8-ea8f-4020-98d7-e22519358792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:33.196482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021250c8-ea8f-4020-98d7-e22519358792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:33.200770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021250c8-ea8f-4020-98d7-e22519358792 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:33.229123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:33.230811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:33.235360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1015/2028] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:33.336615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757920-a87b-4d93-9b8d-485db4fbd4dc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:33.366894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:33.369176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:33.369392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:33.369757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] PATH_INFO: `/v3/projects/ab96247f7ea843ad9189db13040755ab` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:33.371425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab96247f7ea843ad9189db13040755ab)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:33.377798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:33.484071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:33.526298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab96247f7ea843ad9189db13040755ab', 'request_id': 'req-968e2b1a-2378-48e0-8055-80ea0f074dcb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.537959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab96247f7ea843ad9189db13040755ab', 'request_id': 'req-968e2b1a-2378-48e0-8055-80ea0f074dcb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.554125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab96247f7ea843ad9189db13040755ab', 'request_id': 'req-968e2b1a-2378-48e0-8055-80ea0f074dcb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.579503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] The token cache is being invalidate because project ab96247f7ea843ad9189db13040755ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:33.580131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.581293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-968e2b1a-2378-48e0-8055-80ea0f074dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.584671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1014/2029] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:33 2022] DELETE /identity/v3/projects/ab96247f7ea843ad9189db13040755ab => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:33.589752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c838dcb-9b66-4484-a836-2bf37ca754a9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:33.590244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c838dcb-9b66-4484-a836-2bf37ca754a9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:33.590419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c838dcb-9b66-4484-a836-2bf37ca754a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:33.618637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1c838dcb-9b66-4484-a836-2bf37ca754a9 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:33.620456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1c838dcb-9b66-4484-a836-2bf37ca754a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:33.652096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:33.720708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1016/2030] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:33.728631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f4386-b9b6-487d-9b4f-81355921d5de None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:33.728919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f4386-b9b6-487d-9b4f-81355921d5de None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:33.729189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f4386-b9b6-487d-9b4f-81355921d5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:33.776239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-114f4386-b9b6-487d-9b4f-81355921d5de None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:33.777552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-114f4386-b9b6-487d-9b4f-81355921d5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:33.778246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c838dcb-9b66-4484-a836-2bf37ca754a9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:33.781432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1c838dcb-9b66-4484-a836-2bf37ca754a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:33.803212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1015/2031] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:33.807144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f4386-b9b6-487d-9b4f-81355921d5de None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:33.807707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c838dcb-9b66-4484-a836-2bf37ca754a9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:33.813144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:33.814261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:33.814873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:33.815723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] PATH_INFO: `/v3/projects/edaaab2b6d804b94b57e11486db78254` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:33.817888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edaaab2b6d804b94b57e11486db78254)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:33.821719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:33.824942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f4386-b9b6-487d-9b4f-81355921d5de None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:33.837699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6d435-dd71-480f-ba27-06c249a5a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:33.838341 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6d435-dd71-480f-ba27-06c249a5a2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:33.838628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6d435-dd71-480f-ba27-06c249a5a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:33.838899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6d435-dd71-480f-ba27-06c249a5a2f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:33.839727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6d435-dd71-480f-ba27-06c249a5a2f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:33.840033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6d435-dd71-480f-ba27-06c249a5a2f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:33.847308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6d435-dd71-480f-ba27-06c249a5a2f9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:33.867197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1016/2032] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:41:33.871961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6d435-dd71-480f-ba27-06c249a5a2f9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:33.886185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6d435-dd71-480f-ba27-06c249a5a2f9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:33.898683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edaaab2b6d804b94b57e11486db78254', 'request_id': 'req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.914073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edaaab2b6d804b94b57e11486db78254', 'request_id': 'req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.928066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edaaab2b6d804b94b57e11486db78254', 'request_id': 'req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.961122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] The token cache is being invalidate because project edaaab2b6d804b94b57e11486db78254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:33.961671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.962620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4acd3ee-e0d6-4098-9ad7-0d93692bb530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:33.964962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1017/2033] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:33 2022] DELETE /identity/v3/projects/edaaab2b6d804b94b57e11486db78254 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:33.972403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659c9a1-8b84-472c-9b9d-7fd3b6cc0d91 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:33.973041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659c9a1-8b84-472c-9b9d-7fd3b6cc0d91 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:33.973524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659c9a1-8b84-472c-9b9d-7fd3b6cc0d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:33.997974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d659c9a1-8b84-472c-9b9d-7fd3b6cc0d91 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:34.000166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d659c9a1-8b84-472c-9b9d-7fd3b6cc0d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:34.011228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed7fc1-c89d-4da7-a935-161ced0347ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.011906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed7fc1-c89d-4da7-a935-161ced0347ca admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.012189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed7fc1-c89d-4da7-a935-161ced0347ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.012463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed7fc1-c89d-4da7-a935-161ced0347ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.013134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed7fc1-c89d-4da7-a935-161ced0347ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.015259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed7fc1-c89d-4da7-a935-161ced0347ca admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.057243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1017/2034] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:33 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:34.060285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed7fc1-c89d-4da7-a935-161ced0347ca admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.062717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-04ed7fc1-c89d-4da7-a935-161ced0347ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:34.084510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1018/2035] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:34.094131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b22679-d928-4666-9e20-d309269b156f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.094426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b22679-d928-4666-9e20-d309269b156f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.094682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b22679-d928-4666-9e20-d309269b156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.118885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-73b22679-d928-4666-9e20-d309269b156f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:34.120308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-73b22679-d928-4666-9e20-d309269b156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:34.149604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed7fc1-c89d-4da7-a935-161ced0347ca admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.157357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d0733-04f5-40d7-9db2-7391b2ea7701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.158058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d0733-04f5-40d7-9db2-7391b2ea7701 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.158816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d0733-04f5-40d7-9db2-7391b2ea7701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.159127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d0733-04f5-40d7-9db2-7391b2ea7701 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.160667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d0733-04f5-40d7-9db2-7391b2ea7701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.163172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d0733-04f5-40d7-9db2-7391b2ea7701 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.177787 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:34.198809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1019/2036] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:34.204500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b22679-d928-4666-9e20-d309269b156f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.216413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b22679-d928-4666-9e20-d309269b156f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.223781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9a935-4032-4bd6-b1cd-1b04fe5284cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.224595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9a935-4032-4bd6-b1cd-1b04fe5284cb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.224878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9a935-4032-4bd6-b1cd-1b04fe5284cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.225146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9a935-4032-4bd6-b1cd-1b04fe5284cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.225857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9a935-4032-4bd6-b1cd-1b04fe5284cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:34.226159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9a935-4032-4bd6-b1cd-1b04fe5284cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.227958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1018/2037] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:34 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:34.231288 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9a935-4032-4bd6-b1cd-1b04fe5284cb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.232126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d0733-04f5-40d7-9db2-7391b2ea7701 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.245750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d0733-04f5-40d7-9db2-7391b2ea7701 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.246257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1020/2038] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:34.254708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9a935-4032-4bd6-b1cd-1b04fe5284cb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.259789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215833d-9d39-47b5-83bc-d8b9029768d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.261146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215833d-9d39-47b5-83bc-d8b9029768d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.261627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215833d-9d39-47b5-83bc-d8b9029768d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.262501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215833d-9d39-47b5-83bc-d8b9029768d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.263673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215833d-9d39-47b5-83bc-d8b9029768d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.266333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215833d-9d39-47b5-83bc-d8b9029768d2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.269274 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9a935-4032-4bd6-b1cd-1b04fe5284cb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.274259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:34.283340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1019/2039] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:34.284806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215833d-9d39-47b5-83bc-d8b9029768d2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.288055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf9b5-0040-47cc-8214-d809b3d65823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.288837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf9b5-0040-47cc-8214-d809b3d65823 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.289123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf9b5-0040-47cc-8214-d809b3d65823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.289398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf9b5-0040-47cc-8214-d809b3d65823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.290355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cf9b5-0040-47cc-8214-d809b3d65823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.295308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cf9b5-0040-47cc-8214-d809b3d65823 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.299108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215833d-9d39-47b5-83bc-d8b9029768d2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.305359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8bc2-8ed9-459e-9e5c-6d3a5fcb795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.306071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8bc2-8ed9-459e-9e5c-6d3a5fcb795f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.306418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8bc2-8ed9-459e-9e5c-6d3a5fcb795f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.306757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8bc2-8ed9-459e-9e5c-6d3a5fcb795f admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.307858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8bc2-8ed9-459e-9e5c-6d3a5fcb795f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.309572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8bc2-8ed9-459e-9e5c-6d3a5fcb795f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.322311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1020/2040] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:34.326414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8bc2-8ed9-459e-9e5c-6d3a5fcb795f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.343364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1021/2041] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:34 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:34.347353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf9b5-0040-47cc-8214-d809b3d65823 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.354762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8bc2-8ed9-459e-9e5c-6d3a5fcb795f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.419581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf9b5-0040-47cc-8214-d809b3d65823 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.427806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffa5f8-9490-486f-be6d-111581f42d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.428586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffa5f8-9490-486f-be6d-111581f42d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.428878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffa5f8-9490-486f-be6d-111581f42d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.429164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffa5f8-9490-486f-be6d-111581f42d85 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.429887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffa5f8-9490-486f-be6d-111581f42d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.432216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffa5f8-9490-486f-be6d-111581f42d85 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.446534 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd29004-30fb-42af-8578-ec8c405241d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.447730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd29004-30fb-42af-8578-ec8c405241d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.448101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd29004-30fb-42af-8578-ec8c405241d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.448381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd29004-30fb-42af-8578-ec8c405241d4 admin admin] PATH_INFO: `/v3/projects/4c790823211e466e8a5f685fd4d334d9/users/0d7a82606b784b43b2dc634b1418348a/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.463864 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1022/2042] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:34 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:34.473577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffa5f8-9490-486f-be6d-111581f42d85 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.481394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd29004-30fb-42af-8578-ec8c405241d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c790823211e466e8a5f685fd4d334d9, user_id=0d7a82606b784b43b2dc634b1418348a, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.485297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd29004-30fb-42af-8578-ec8c405241d4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.487087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffa5f8-9490-486f-be6d-111581f42d85 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.495182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32ccb-36bd-4f3e-a0cc-a68bb4f17ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.496918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32ccb-36bd-4f3e-a0cc-a68bb4f17ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.498536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32ccb-36bd-4f3e-a0cc-a68bb4f17ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.498955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb32ccb-36bd-4f3e-a0cc-a68bb4f17ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.500948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32ccb-36bd-4f3e-a0cc-a68bb4f17ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.506137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb32ccb-36bd-4f3e-a0cc-a68bb4f17ae1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.509140 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1021/2043] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:34 2022] PUT /identity/v3/projects/4c790823211e466e8a5f685fd4d334d9/users/0d7a82606b784b43b2dc634b1418348a/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:34.514884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618f7b-de2c-43fe-bce7-2f728e862809 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.515442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618f7b-de2c-43fe-bce7-2f728e862809 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.515744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618f7b-de2c-43fe-bce7-2f728e862809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.521786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1023/2044] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:34.526711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32ccb-36bd-4f3e-a0cc-a68bb4f17ae1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.537767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb32ccb-36bd-4f3e-a0cc-a68bb4f17ae1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.544448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-71618f7b-de2c-43fe-bce7-2f728e862809 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:34.546009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-71618f7b-de2c-43fe-bce7-2f728e862809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:34.638428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1022/2045] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:34.646612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71618f7b-de2c-43fe-bce7-2f728e862809 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.648687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994051bf-8f83-4bd6-afde-7c458cd6232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.649168 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-71618f7b-de2c-43fe-bce7-2f728e862809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:34.649464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994051bf-8f83-4bd6-afde-7c458cd6232b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.649746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994051bf-8f83-4bd6-afde-7c458cd6232b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.650018 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994051bf-8f83-4bd6-afde-7c458cd6232b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.650724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994051bf-8f83-4bd6-afde-7c458cd6232b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.652486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994051bf-8f83-4bd6-afde-7c458cd6232b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.666620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1024/2046] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:34.672161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994051bf-8f83-4bd6-afde-7c458cd6232b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.686883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994051bf-8f83-4bd6-afde-7c458cd6232b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.693763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d552b5-78fb-40d8-b659-73012ee8b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.694459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d552b5-78fb-40d8-b659-73012ee8b82f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.694738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d552b5-78fb-40d8-b659-73012ee8b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.695236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d552b5-78fb-40d8-b659-73012ee8b82f admin admin] PATH_INFO: `/v3/projects/1c747cefee4b4e178a99ec685c4621d4/users/e9b7e3b55e9f4085b5ddf4de45ed9a7f/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.720741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d552b5-78fb-40d8-b659-73012ee8b82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c747cefee4b4e178a99ec685c4621d4, user_id=e9b7e3b55e9f4085b5ddf4de45ed9a7f, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.725148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d552b5-78fb-40d8-b659-73012ee8b82f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.730583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71618f7b-de2c-43fe-bce7-2f728e862809 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:34.736227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16463e-12c3-48c4-8578-1fea694e91bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:34.737238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16463e-12c3-48c4-8578-1fea694e91bb service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.738070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16463e-12c3-48c4-8578-1fea694e91bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.738070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16463e-12c3-48c4-8578-1fea694e91bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.753090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16463e-12c3-48c4-8578-1fea694e91bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:34.755073 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16463e-12c3-48c4-8578-1fea694e91bb service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:34.767314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1025/2047] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:34 2022] PUT /identity/v3/projects/1c747cefee4b4e178a99ec685c4621d4/users/e9b7e3b55e9f4085b5ddf4de45ed9a7f/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:34.772094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607a02b-7180-4e80-994c-41efd7450c12 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:34.772510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607a02b-7180-4e80-994c-41efd7450c12 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:34.772951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607a02b-7180-4e80-994c-41efd7450c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:34.773526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1023/2048] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:34.782604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:34.810721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4607a02b-7180-4e80-994c-41efd7450c12 None None] MFA Rules not processed for user `e9b7e3b55e9f4085b5ddf4de45ed9a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:34.812017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4607a02b-7180-4e80-994c-41efd7450c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:34.925737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1026/2049] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:34.944545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16463e-12c3-48c4-8578-1fea694e91bb service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:34.946608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5f16463e-12c3-48c4-8578-1fea694e91bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:34.990243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:35.148922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16463e-12c3-48c4-8578-1fea694e91bb service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:35.316859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a750287-c392-4c88-8769-e34ee02afbcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:35.317639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a750287-c392-4c88-8769-e34ee02afbcb service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:35.317860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a750287-c392-4c88-8769-e34ee02afbcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:35.318355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a750287-c392-4c88-8769-e34ee02afbcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:35.341241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a750287-c392-4c88-8769-e34ee02afbcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:35.342628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a750287-c392-4c88-8769-e34ee02afbcb service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:35.372602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1024/2050] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:36.983766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8288-b1b3-49da-bef3-f8a7a3fe61aa None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:36.984269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8288-b1b3-49da-bef3-f8a7a3fe61aa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:36.984349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8288-b1b3-49da-bef3-f8a7a3fe61aa None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:36.987766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1027/2051] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:41:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:41:37.081027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea0ad-279b-4716-bdb0-9c28c8733092 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:37.081592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea0ad-279b-4716-bdb0-9c28c8733092 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:37.081680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ea0ad-279b-4716-bdb0-9c28c8733092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:37.131097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-319ea0ad-279b-4716-bdb0-9c28c8733092 None None] MFA Rules not processed for user `a5c20a5a655b43d1899bf2319647a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:37.132404 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-319ea0ad-279b-4716-bdb0-9c28c8733092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:37.292278 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba8288-b1b3-49da-bef3-f8a7a3fe61aa None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:37.294960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dbba8288-b1b3-49da-bef3-f8a7a3fe61aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:37.409900 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1025/2052] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:41:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:37.426117 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ea0ad-279b-4716-bdb0-9c28c8733092 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:37.427569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-319ea0ad-279b-4716-bdb0-9c28c8733092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:37.449827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ea0ad-279b-4716-bdb0-9c28c8733092 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:37.460590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e2410-f105-4168-b7d0-6b6709752507 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:37.462296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e2410-f105-4168-b7d0-6b6709752507 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:37.462626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e2410-f105-4168-b7d0-6b6709752507 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:37.463015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e2410-f105-4168-b7d0-6b6709752507 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:37.486555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e2410-f105-4168-b7d0-6b6709752507 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:37.488908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e2410-f105-4168-b7d0-6b6709752507 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:37.499388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba8288-b1b3-49da-bef3-f8a7a3fe61aa None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:37.506051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:37.506779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:37.507161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:37.507574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] PATH_INFO: `/v3/users/0a1e2409e3df40668c2ddbb6800ab7f7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:37.509300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1e2409e3df40668c2ddbb6800ab7f7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:37.512592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:37.515787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1026/2053] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:37.678674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1e2409e3df40668c2ddbb6800ab7f7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:37.679840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1e2409e3df40668c2ddbb6800ab7f7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:37.712559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1e2409e3df40668c2ddbb6800ab7f7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:37.722035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1e2409e3df40668c2ddbb6800ab7f7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:37.742164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-0bd5a4ef-a8e2-41b7-8ad5-22396270b979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1e2409e3df40668c2ddbb6800ab7f7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:37.755118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1028/2054] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:37 2022] DELETE /identity/v3/users/0a1e2409e3df40668c2ddbb6800ab7f7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:38.097681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e2410-f105-4168-b7d0-6b6709752507 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:38.111202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e2410-f105-4168-b7d0-6b6709752507 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:38.209837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:38.218916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:38.220587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:38.220587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:38.220587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] PATH_INFO: `/v3/projects/307abeafeca74689adfa01a7ae804700` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:38.222224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=307abeafeca74689adfa01a7ae804700)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:38.227327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:38.293504 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307abeafeca74689adfa01a7ae804700', 'request_id': 'req-5081efc2-b123-495e-9f05-3de22fc5aaf0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.299912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307abeafeca74689adfa01a7ae804700', 'request_id': 'req-5081efc2-b123-495e-9f05-3de22fc5aaf0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.307931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307abeafeca74689adfa01a7ae804700', 'request_id': 'req-5081efc2-b123-495e-9f05-3de22fc5aaf0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.322468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] The token cache is being invalidate because project 307abeafeca74689adfa01a7ae804700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:38.322751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.323418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5081efc2-b123-495e-9f05-3de22fc5aaf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.324910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1027/2055] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:38 2022] DELETE /identity/v3/projects/307abeafeca74689adfa01a7ae804700 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:38.329874 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4758-fde2-4dd1-97a4-b41aa9de56ec None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:38.330352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4758-fde2-4dd1-97a4-b41aa9de56ec None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:38.330465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4758-fde2-4dd1-97a4-b41aa9de56ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:38.351980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cd6f4758-fde2-4dd1-97a4-b41aa9de56ec None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:38.353185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cd6f4758-fde2-4dd1-97a4-b41aa9de56ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:38.366355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:38.446634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1029/2056] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:38.459704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16883959-69bc-41b1-a672-923d1d1ce4e2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:38.460168 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16883959-69bc-41b1-a672-923d1d1ce4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:38.460545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16883959-69bc-41b1-a672-923d1d1ce4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:38.496776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-16883959-69bc-41b1-a672-923d1d1ce4e2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:38.498041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-16883959-69bc-41b1-a672-923d1d1ce4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:38.511075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1028/2057] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:38.514044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f4758-fde2-4dd1-97a4-b41aa9de56ec None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:38.528572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f4758-fde2-4dd1-97a4-b41aa9de56ec None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:38.545433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:38.546124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:38.546440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:38.546708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:38.547528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:38.547832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:38.549707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:38.569855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1030/2058] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:38.570195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16883959-69bc-41b1-a672-923d1d1ce4e2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:38.585787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16883959-69bc-41b1-a672-923d1d1ce4e2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:38.593862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b807df-1a7a-45b6-9a11-895f299559c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:38.594597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b807df-1a7a-45b6-9a11-895f299559c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:38.594948 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b807df-1a7a-45b6-9a11-895f299559c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:38.598557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b807df-1a7a-45b6-9a11-895f299559c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:38.598557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b807df-1a7a-45b6-9a11-895f299559c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:38.598557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b807df-1a7a-45b6-9a11-895f299559c7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:38.599963 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:38.601742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:38.624074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fdff8-6d07-446c-896f-f6824279928c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:38.638930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:38.639628 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:38.639894 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:38.640241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] PATH_INFO: `/v3/users/e9b7e3b55e9f4085b5ddf4de45ed9a7f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:38.642899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b7e3b55e9f4085b5ddf4de45ed9a7f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:38.645095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:38.673950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1029/2059] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:38 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:38.678554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b807df-1a7a-45b6-9a11-895f299559c7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:38.764560 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b7e3b55e9f4085b5ddf4de45ed9a7f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.766395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b7e3b55e9f4085b5ddf4de45ed9a7f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.795682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b7e3b55e9f4085b5ddf4de45ed9a7f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.807330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b807df-1a7a-45b6-9a11-895f299559c7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:38.813268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b7e3b55e9f4085b5ddf4de45ed9a7f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.823095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43424cb2-8a0e-41e5-850e-6e791f014066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:38.824139 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43424cb2-8a0e-41e5-850e-6e791f014066 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:38.824435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43424cb2-8a0e-41e5-850e-6e791f014066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:38.824759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43424cb2-8a0e-41e5-850e-6e791f014066 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:38.825940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43424cb2-8a0e-41e5-850e-6e791f014066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:38.830569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a3abf035-b2b7-4585-86e8-eced056af56a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b7e3b55e9f4085b5ddf4de45ed9a7f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:38.834742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43424cb2-8a0e-41e5-850e-6e791f014066 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:38.842812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1031/2060] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:38 2022] DELETE /identity/v3/users/e9b7e3b55e9f4085b5ddf4de45ed9a7f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:38.850436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850063fb-b0fc-4fd4-994b-cba8b9be9097 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:38.851062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850063fb-b0fc-4fd4-994b-cba8b9be9097 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:38.852961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850063fb-b0fc-4fd4-994b-cba8b9be9097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:38.888587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1030/2061] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:38 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:38.896203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43424cb2-8a0e-41e5-850e-6e791f014066 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:38.896862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-850063fb-b0fc-4fd4-994b-cba8b9be9097 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:38.898361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-850063fb-b0fc-4fd4-994b-cba8b9be9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:38.902785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-43424cb2-8a0e-41e5-850e-6e791f014066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:38.931095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43424cb2-8a0e-41e5-850e-6e791f014066 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:38.987031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1032/2062] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:38.998543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850063fb-b0fc-4fd4-994b-cba8b9be9097 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:39.001071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-850063fb-b0fc-4fd4-994b-cba8b9be9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:39.024609 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:39.047405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:39.081229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e798f0-dd41-4ae3-b1c0-6be7a2b39e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:39.081926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e798f0-dd41-4ae3-b1c0-6be7a2b39e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:39.082365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e798f0-dd41-4ae3-b1c0-6be7a2b39e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:39.084961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e798f0-dd41-4ae3-b1c0-6be7a2b39e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:39.085640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e798f0-dd41-4ae3-b1c0-6be7a2b39e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:39.087670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e798f0-dd41-4ae3-b1c0-6be7a2b39e38 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:39.105047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1031/2063] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:39.106223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e798f0-dd41-4ae3-b1c0-6be7a2b39e38 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:39.120573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e798f0-dd41-4ae3-b1c0-6be7a2b39e38 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:39.126551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff173d91-2d7d-45c4-897b-f17c1a887585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:39.127664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff173d91-2d7d-45c4-897b-f17c1a887585 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:39.128112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff173d91-2d7d-45c4-897b-f17c1a887585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:39.128645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff173d91-2d7d-45c4-897b-f17c1a887585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:39.129859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff173d91-2d7d-45c4-897b-f17c1a887585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:39.130280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850063fb-b0fc-4fd4-994b-cba8b9be9097 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:39.132352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff173d91-2d7d-45c4-897b-f17c1a887585 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:39.142414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b09e-abe2-4caa-b5ff-089efb855094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:39.143871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b09e-abe2-4caa-b5ff-089efb855094 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:39.144228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b09e-abe2-4caa-b5ff-089efb855094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:39.144603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b09e-abe2-4caa-b5ff-089efb855094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:39.151687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1032/2064] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:39.154925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff173d91-2d7d-45c4-897b-f17c1a887585 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:39.171876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff173d91-2d7d-45c4-897b-f17c1a887585 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:39.177596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c1962-51f4-494a-9c76-fb03801f9283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:39.178299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c1962-51f4-494a-9c76-fb03801f9283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:39.178580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c1962-51f4-494a-9c76-fb03801f9283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:39.178904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c1962-51f4-494a-9c76-fb03801f9283 admin admin] PATH_INFO: `/v3/projects/47dd3534c5fc49c8afdd89bd3d795c08/users/cdee72173dba44bfb30ae744e869638f/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:39.179381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b09e-abe2-4caa-b5ff-089efb855094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:39.183075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b09e-abe2-4caa-b5ff-089efb855094 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:39.199282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c1962-51f4-494a-9c76-fb03801f9283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47dd3534c5fc49c8afdd89bd3d795c08, user_id=cdee72173dba44bfb30ae744e869638f, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:39.203445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c1962-51f4-494a-9c76-fb03801f9283 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:39.211898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1033/2065] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:39.232763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1033/2066] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:39 2022] PUT /identity/v3/projects/47dd3534c5fc49c8afdd89bd3d795c08/users/cdee72173dba44bfb30ae744e869638f/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:39.245694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb99591-a804-445f-9abd-a8331ce587b4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:39.246337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb99591-a804-445f-9abd-a8331ce587b4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:39.246901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb99591-a804-445f-9abd-a8331ce587b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:39.336299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ecb99591-a804-445f-9abd-a8331ce587b4 None None] MFA Rules not processed for user `cdee72173dba44bfb30ae744e869638f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:39.341201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ecb99591-a804-445f-9abd-a8331ce587b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:39.509616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1034/2067] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:39.514148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c1962-51f4-494a-9c76-fb03801f9283 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:39.632965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c1962-51f4-494a-9c76-fb03801f9283 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:39.638726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eeee4-3afe-42af-bd96-9eef9c0fa885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:39.639662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eeee4-3afe-42af-bd96-9eef9c0fa885 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:39.640170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eeee4-3afe-42af-bd96-9eef9c0fa885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:39.640547 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eeee4-3afe-42af-bd96-9eef9c0fa885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:39.641531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eeee4-3afe-42af-bd96-9eef9c0fa885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:39.643728 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eeee4-3afe-42af-bd96-9eef9c0fa885 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:39.694082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1034/2068] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:39 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:39.695639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb99591-a804-445f-9abd-a8331ce587b4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:39.711143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb99591-a804-445f-9abd-a8331ce587b4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:39.946347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832426e-47ec-4b5d-b1a3-2fcde57d9ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:39.946347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832426e-47ec-4b5d-b1a3-2fcde57d9ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:39.946581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832426e-47ec-4b5d-b1a3-2fcde57d9ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:39.946759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832426e-47ec-4b5d-b1a3-2fcde57d9ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:39.946886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eeee4-3afe-42af-bd96-9eef9c0fa885 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:39.947725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832426e-47ec-4b5d-b1a3-2fcde57d9ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:39.948708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-027eeee4-3afe-42af-bd96-9eef9c0fa885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:39.949991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832426e-47ec-4b5d-b1a3-2fcde57d9ad7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:39.977967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eeee4-3afe-42af-bd96-9eef9c0fa885 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:39.995148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:39.996213 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:39.996661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:39.997141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] PATH_INFO: `/v3/projects/1c747cefee4b4e178a99ec685c4621d4` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:39.998591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c747cefee4b4e178a99ec685c4621d4)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:39.999769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1035/2069] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:39 2022] POST /identity/v3/users => generated 297 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:40.001376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:40.012857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832426e-47ec-4b5d-b1a3-2fcde57d9ad7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:40.032066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832426e-47ec-4b5d-b1a3-2fcde57d9ad7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:40.048475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295c616-2e05-4ce7-8b0f-dd10024a7269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:40.049106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c616-2e05-4ce7-8b0f-dd10024a7269 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.049379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c616-2e05-4ce7-8b0f-dd10024a7269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.049649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295c616-2e05-4ce7-8b0f-dd10024a7269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.050350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295c616-2e05-4ce7-8b0f-dd10024a7269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:40.052583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295c616-2e05-4ce7-8b0f-dd10024a7269 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:40.074694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1036/2070] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:40.077813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295c616-2e05-4ce7-8b0f-dd10024a7269 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:40.102646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295c616-2e05-4ce7-8b0f-dd10024a7269 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:40.113202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c747cefee4b4e178a99ec685c4621d4', 'request_id': 'req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:40.122436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c747cefee4b4e178a99ec685c4621d4', 'request_id': 'req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:40.134727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c747cefee4b4e178a99ec685c4621d4', 'request_id': 'req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:40.154618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:40.158007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] The token cache is being invalidate because project 1c747cefee4b4e178a99ec685c4621d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:40.159420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:40.162595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-ed3b119b-a878-4e74-9d72-b6da81ddf4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:40.168721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1035/2071] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:39 2022] DELETE /identity/v3/projects/1c747cefee4b4e178a99ec685c4621d4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:40.179152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c975d-0f47-4082-85c6-ff5ce9e42da7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.179667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c975d-0f47-4082-85c6-ff5ce9e42da7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.180216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c975d-0f47-4082-85c6-ff5ce9e42da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.220013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ff9c975d-0f47-4082-85c6-ff5ce9e42da7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:40.221240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ff9c975d-0f47-4082-85c6-ff5ce9e42da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:40.230687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773353b-c877-417d-95dd-4f9047dd0570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:40.231412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773353b-c877-417d-95dd-4f9047dd0570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.232171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773353b-c877-417d-95dd-4f9047dd0570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.232467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773353b-c877-417d-95dd-4f9047dd0570 admin admin] PATH_INFO: `/v3/projects/52556103237b4be19ffcba7c6c1344b7/users/b466b5b2d0fd437db4e2fa136a7f2fb1/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.233010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:40.255704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773353b-c877-417d-95dd-4f9047dd0570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52556103237b4be19ffcba7c6c1344b7, user_id=b466b5b2d0fd437db4e2fa136a7f2fb1, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:40.258435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773353b-c877-417d-95dd-4f9047dd0570 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:40.279583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1037/2072] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:40 2022] PUT /identity/v3/projects/52556103237b4be19ffcba7c6c1344b7/users/b466b5b2d0fd437db4e2fa136a7f2fb1/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:40.286200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773353b-c877-417d-95dd-4f9047dd0570 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:40.292041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9773353b-c877-417d-95dd-4f9047dd0570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:40.305253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1036/2073] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:40.313955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfeea9-be7f-4545-ab23-9ebb90b91a6a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.313955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfeea9-be7f-4545-ab23-9ebb90b91a6a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.314523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfeea9-be7f-4545-ab23-9ebb90b91a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.334822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-d3dfeea9-be7f-4545-ab23-9ebb90b91a6a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:40.336077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d3dfeea9-be7f-4545-ab23-9ebb90b91a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:40.416746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773353b-c877-417d-95dd-4f9047dd0570 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:40.426918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff5a3b-1b48-4bfc-901a-4c618279974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:40.429586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5a3b-1b48-4bfc-901a-4c618279974f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.431252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5a3b-1b48-4bfc-901a-4c618279974f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.431534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5a3b-1b48-4bfc-901a-4c618279974f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.432266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff5a3b-1b48-4bfc-901a-4c618279974f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:40.434576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff5a3b-1b48-4bfc-901a-4c618279974f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:40.457539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1037/2074] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:40.463132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfeea9-be7f-4545-ab23-9ebb90b91a6a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:40.498146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1038/2075] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:40.499168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff5a3b-1b48-4bfc-901a-4c618279974f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:40.510840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfeea9-be7f-4545-ab23-9ebb90b91a6a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:40.525153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4d5c-0b81-4042-9372-847e4e7b1c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:40.526523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff5a3b-1b48-4bfc-901a-4c618279974f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:40.527275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4d5c-0b81-4042-9372-847e4e7b1c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.527560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4d5c-0b81-4042-9372-847e4e7b1c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.528292 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4d5c-0b81-4042-9372-847e4e7b1c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.529013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4d5c-0b81-4042-9372-847e4e7b1c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:40.529318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4d5c-0b81-4042-9372-847e4e7b1c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:40.531035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4d5c-0b81-4042-9372-847e4e7b1c64 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:40.537860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74dd71-f64b-4177-afb3-cfc20e202faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:40.538559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74dd71-f64b-4177-afb3-cfc20e202faa admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.538840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74dd71-f64b-4177-afb3-cfc20e202faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.539148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74dd71-f64b-4177-afb3-cfc20e202faa admin admin] PATH_INFO: `/v3/projects/52556103237b4be19ffcba7c6c1344b7/users/b466b5b2d0fd437db4e2fa136a7f2fb1/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.543005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74dd71-f64b-4177-afb3-cfc20e202faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=52556103237b4be19ffcba7c6c1344b7, user_id=b466b5b2d0fd437db4e2fa136a7f2fb1, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:40.551949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74dd71-f64b-4177-afb3-cfc20e202faa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:40.562004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1038/2076] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:40.574590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4d5c-0b81-4042-9372-847e4e7b1c64 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:40.585904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1039/2077] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:40 2022] PUT /identity/v3/projects/52556103237b4be19ffcba7c6c1344b7/users/b466b5b2d0fd437db4e2fa136a7f2fb1/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:40.596588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deef70-c13a-44cc-ba05-063907a9254e None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.596879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deef70-c13a-44cc-ba05-063907a9254e None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.597161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deef70-c13a-44cc-ba05-063907a9254e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.601588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4d5c-0b81-4042-9372-847e4e7b1c64 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:40.646450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f8deef70-c13a-44cc-ba05-063907a9254e None None] MFA Rules not processed for user `b466b5b2d0fd437db4e2fa136a7f2fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:40.648033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8deef70-c13a-44cc-ba05-063907a9254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:40.749437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b701f0d-95b8-4a38-b5ae-02b09f7a558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:40.750195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b701f0d-95b8-4a38-b5ae-02b09f7a558a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.750625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b701f0d-95b8-4a38-b5ae-02b09f7a558a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.750904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b701f0d-95b8-4a38-b5ae-02b09f7a558a admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.751722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b701f0d-95b8-4a38-b5ae-02b09f7a558a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:40.757528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b701f0d-95b8-4a38-b5ae-02b09f7a558a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:40.767580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1040/2078] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:40.799759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deef70-c13a-44cc-ba05-063907a9254e None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:40.803673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8deef70-c13a-44cc-ba05-063907a9254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:40.819513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1039/2079] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:40 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:40.823517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b701f0d-95b8-4a38-b5ae-02b09f7a558a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:40.852354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:40.877405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:40.917490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b701f0d-95b8-4a38-b5ae-02b09f7a558a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:40.935310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750e45-359c-4837-94b4-99081bd22af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:40.935310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750e45-359c-4837-94b4-99081bd22af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.935310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750e45-359c-4837-94b4-99081bd22af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.935310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750e45-359c-4837-94b4-99081bd22af3 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.936291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17750e45-359c-4837-94b4-99081bd22af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:40.936291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17750e45-359c-4837-94b4-99081bd22af3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:40.948432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deef70-c13a-44cc-ba05-063907a9254e None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:40.965007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1040/2080] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:40 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:40.969650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750e45-359c-4837-94b4-99081bd22af3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:40.990373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750e45-359c-4837-94b4-99081bd22af3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:40.995784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf377606-8ed7-431d-9d60-578a5006a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:40.996760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf377606-8ed7-431d-9d60-578a5006a4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:40.997188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf377606-8ed7-431d-9d60-578a5006a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:40.997615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf377606-8ed7-431d-9d60-578a5006a4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:40.998834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf377606-8ed7-431d-9d60-578a5006a4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:41.000804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf377606-8ed7-431d-9d60-578a5006a4c2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:41.008847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5308-ea46-4e52-9411-3f9a82728941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:41.009796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5308-ea46-4e52-9411-3f9a82728941 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:41.010355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5308-ea46-4e52-9411-3f9a82728941 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:41.010940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5308-ea46-4e52-9411-3f9a82728941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:41.012431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1041/2081] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:41.013349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf377606-8ed7-431d-9d60-578a5006a4c2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:41.016225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cf377606-8ed7-431d-9d60-578a5006a4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:41.030254 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf377606-8ed7-431d-9d60-578a5006a4c2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:41.034304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3634b2a-4092-4d07-8283-85c5aedd5b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:41.035077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3634b2a-4092-4d07-8283-85c5aedd5b7e service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:41.035852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3634b2a-4092-4d07-8283-85c5aedd5b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:41.036131 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3634b2a-4092-4d07-8283-85c5aedd5b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:41.037971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a3634b2a-4092-4d07-8283-85c5aedd5b7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:41.103082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5308-ea46-4e52-9411-3f9a82728941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:41.104800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5308-ea46-4e52-9411-3f9a82728941 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:41.117469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1041/2082] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:41:41.118150 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3634b2a-4092-4d07-8283-85c5aedd5b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:41.118931 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5308-ea46-4e52-9411-3f9a82728941 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:41.119717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3634b2a-4092-4d07-8283-85c5aedd5b7e service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:41.135673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5308-ea46-4e52-9411-3f9a82728941 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:41.145674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1042/2083] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:41.147776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bf0aa-6072-4e74-9be6-b5ad906cac68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:41.148511 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf0aa-6072-4e74-9be6-b5ad906cac68 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:41.148911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf0aa-6072-4e74-9be6-b5ad906cac68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:41.149333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf0aa-6072-4e74-9be6-b5ad906cac68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:41.151324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bf0aa-6072-4e74-9be6-b5ad906cac68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:41.153608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bf0aa-6072-4e74-9be6-b5ad906cac68 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:41.180054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3634b2a-4092-4d07-8283-85c5aedd5b7e service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:41.181820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1042/2084] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:41.211958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3634b2a-4092-4d07-8283-85c5aedd5b7e service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:41.235048 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb66d5-589a-4492-b940-240f5fdcc0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:41.237873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb66d5-589a-4492-b940-240f5fdcc0a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:41.238197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb66d5-589a-4492-b940-240f5fdcc0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:41.238481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb66d5-589a-4492-b940-240f5fdcc0a9 admin admin] PATH_INFO: `/v3/projects/23092f14b3e44d1695c6625f641fd2b8/users/a53e967edef644a0a34eac18ff4d9038/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:41.309208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb66d5-589a-4492-b940-240f5fdcc0a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23092f14b3e44d1695c6625f641fd2b8, user_id=a53e967edef644a0a34eac18ff4d9038, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:41.315064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb66d5-589a-4492-b940-240f5fdcc0a9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:41.352572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1043/2085] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:41 2022] PUT /identity/v3/projects/23092f14b3e44d1695c6625f641fd2b8/users/a53e967edef644a0a34eac18ff4d9038/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:41.363497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df93ba5-5238-4108-a07f-7e82520b0bbd None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:41.363726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df93ba5-5238-4108-a07f-7e82520b0bbd None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:41.364111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df93ba5-5238-4108-a07f-7e82520b0bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:41.395264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb66d5-589a-4492-b940-240f5fdcc0a9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:41.401605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-94eb66d5-589a-4492-b940-240f5fdcc0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:41.480052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1df93ba5-5238-4108-a07f-7e82520b0bbd None None] MFA Rules not processed for user `a53e967edef644a0a34eac18ff4d9038`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:41.481416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1df93ba5-5238-4108-a07f-7e82520b0bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:41.606135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb66d5-589a-4492-b940-240f5fdcc0a9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:41.607668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:41.614605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1043/2086] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:41.615754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df93ba5-5238-4108-a07f-7e82520b0bbd None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:41.620331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:41.624855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:41.625177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:41.625464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] PATH_INFO: `/v3/users/e7fbb54a6ad940649e0e369932bbd39a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:41.630301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fbb54a6ad940649e0e369932bbd39a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:41.632492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:41.673334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:41.704607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df93ba5-5238-4108-a07f-7e82520b0bbd None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:41.715532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68cae0-d0e8-4418-ba2a-d9df658461f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:41.716220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68cae0-d0e8-4418-ba2a-d9df658461f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:41.716504 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68cae0-d0e8-4418-ba2a-d9df658461f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:41.716779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68cae0-d0e8-4418-ba2a-d9df658461f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:41.725094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9c68cae0-d0e8-4418-ba2a-d9df658461f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:41.733648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fbb54a6ad940649e0e369932bbd39a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:41.735497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fbb54a6ad940649e0e369932bbd39a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:41.775141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fbb54a6ad940649e0e369932bbd39a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:41.789591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fbb54a6ad940649e0e369932bbd39a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:41.790785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fbb54a6ad940649e0e369932bbd39a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:41.827286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1044/2087] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:41 2022] DELETE /identity/v3/users/e7fbb54a6ad940649e0e369932bbd39a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:41.828601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:41.830268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:41.880781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68cae0-d0e8-4418-ba2a-d9df658461f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:41.882813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68cae0-d0e8-4418-ba2a-d9df658461f8 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:41.894807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1044/2088] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:41.896598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9f7f-011b-4cd0-b18a-4ac4c20a67a4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:41.897706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9f7f-011b-4cd0-b18a-4ac4c20a67a4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:41.898222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9f7f-011b-4cd0-b18a-4ac4c20a67a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:41.923589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-709b9f7f-011b-4cd0-b18a-4ac4c20a67a4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:41.928363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-709b9f7f-011b-4cd0-b18a-4ac4c20a67a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:41.953773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d4c5b-594b-4a85-8ca3-7c368364e30f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:41.960903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:41.961565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:41.961847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:41.963588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:41.968644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:42.038780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1045/2089] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:42.040891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d8edc-682a-4919-86b1-093ff54ae791 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:42.041336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d8edc-682a-4919-86b1-093ff54ae791 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:42.041791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d8edc-682a-4919-86b1-093ff54ae791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:42.076246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-674d8edc-682a-4919-86b1-093ff54ae791 None None] MFA Rules not processed for user `0d7a82606b784b43b2dc634b1418348a`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:42.078160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-674d8edc-682a-4919-86b1-093ff54ae791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:42.104850 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:42.106846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:42.127301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1045/2090] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:42.129772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:42.132069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:42.168525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:42.203246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1046/2091] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:42.208650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d8edc-682a-4919-86b1-093ff54ae791 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:42.211076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-674d8edc-682a-4919-86b1-093ff54ae791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:42.219872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a59d2-0f8b-432a-bbe5-b3b95575a4f4 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:42.230420 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aebf22-ed5b-404d-8548-01d09fefef1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:42.230616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d8edc-682a-4919-86b1-093ff54ae791 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:42.231398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aebf22-ed5b-404d-8548-01d09fefef1d service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:42.231825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aebf22-ed5b-404d-8548-01d09fefef1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:42.232246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aebf22-ed5b-404d-8548-01d09fefef1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:42.239682 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:42.241162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803f404-2cbb-463a-9447-41a68fed448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:42.243149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f404-2cbb-463a-9447-41a68fed448d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:42.244322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f404-2cbb-463a-9447-41a68fed448d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:42.244568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aebf22-ed5b-404d-8548-01d09fefef1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:42.246471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aebf22-ed5b-404d-8548-01d09fefef1d service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:42.246633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f404-2cbb-463a-9447-41a68fed448d admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:42.247430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803f404-2cbb-463a-9447-41a68fed448d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:42.249399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803f404-2cbb-463a-9447-41a68fed448d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:42.265084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1046/2092] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:42.325902 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1047/2093] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:42 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:42.333197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aebf22-ed5b-404d-8548-01d09fefef1d service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:42.344957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aebf22-ed5b-404d-8548-01d09fefef1d service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:42.483630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22f679-03bb-4e1a-86eb-6e9fd1c75315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:42.499901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22f679-03bb-4e1a-86eb-6e9fd1c75315 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:42.499901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22f679-03bb-4e1a-86eb-6e9fd1c75315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:42.499901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22f679-03bb-4e1a-86eb-6e9fd1c75315 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:42.499901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22f679-03bb-4e1a-86eb-6e9fd1c75315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:42.499901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22f679-03bb-4e1a-86eb-6e9fd1c75315 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:42.539064 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803f404-2cbb-463a-9447-41a68fed448d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:42.545524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1047/2094] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:42 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:42.553083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803f404-2cbb-463a-9447-41a68fed448d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:42.560455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85302d0-6a43-4931-a2c6-efae6ef30ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:42.561338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85302d0-6a43-4931-a2c6-efae6ef30ccf admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:42.561715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85302d0-6a43-4931-a2c6-efae6ef30ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:42.562088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85302d0-6a43-4931-a2c6-efae6ef30ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:42.562996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85302d0-6a43-4931-a2c6-efae6ef30ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:42.565467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85302d0-6a43-4931-a2c6-efae6ef30ccf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:42.611512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22f679-03bb-4e1a-86eb-6e9fd1c75315 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:42.614370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1048/2095] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:42.636227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22f679-03bb-4e1a-86eb-6e9fd1c75315 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:42.675158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0894cc-1b54-4bb9-9768-aa09fd946e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:42.676416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0894cc-1b54-4bb9-9768-aa09fd946e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:42.676729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0894cc-1b54-4bb9-9768-aa09fd946e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:42.677022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0894cc-1b54-4bb9-9768-aa09fd946e39 admin admin] PATH_INFO: `/v3/projects/3c1dcc9730264b099006d324c30f0d2c/users/e2cd2758dd5e4e6a88363e5a22550289/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:42.699206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0894cc-1b54-4bb9-9768-aa09fd946e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1dcc9730264b099006d324c30f0d2c, user_id=e2cd2758dd5e4e6a88363e5a22550289, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:42.702250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0894cc-1b54-4bb9-9768-aa09fd946e39 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:42.728323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1048/2096] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:42 2022] PUT /identity/v3/projects/3c1dcc9730264b099006d324c30f0d2c/users/e2cd2758dd5e4e6a88363e5a22550289/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:42.729847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85302d0-6a43-4931-a2c6-efae6ef30ccf admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:42.747273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85302d0-6a43-4931-a2c6-efae6ef30ccf admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:42.864211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcd212-e6e0-4874-8681-19291f95ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:42.864856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcd212-e6e0-4874-8681-19291f95ab7b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:42.865537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcd212-e6e0-4874-8681-19291f95ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:42.865714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcd212-e6e0-4874-8681-19291f95ab7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:42.866532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcd212-e6e0-4874-8681-19291f95ab7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:42.868477 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcd212-e6e0-4874-8681-19291f95ab7b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:42.888921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1049/2097] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:42.890264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0894cc-1b54-4bb9-9768-aa09fd946e39 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:42.901622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0894cc-1b54-4bb9-9768-aa09fd946e39 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:42.908726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010de0b-e4c3-4393-81f2-56279ba43610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:42.908726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010de0b-e4c3-4393-81f2-56279ba43610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:42.908980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010de0b-e4c3-4393-81f2-56279ba43610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:42.909704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010de0b-e4c3-4393-81f2-56279ba43610 admin admin] PATH_INFO: `/v3/projects/3c1dcc9730264b099006d324c30f0d2c/users/e2cd2758dd5e4e6a88363e5a22550289/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:42.912327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010de0b-e4c3-4393-81f2-56279ba43610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1dcc9730264b099006d324c30f0d2c, user_id=e2cd2758dd5e4e6a88363e5a22550289, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:42.915427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010de0b-e4c3-4393-81f2-56279ba43610 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:42.936099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1049/2098] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:42 2022] PUT /identity/v3/projects/3c1dcc9730264b099006d324c30f0d2c/users/e2cd2758dd5e4e6a88363e5a22550289/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:42.993385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcd212-e6e0-4874-8681-19291f95ab7b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:42.997028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c4bcd212-e6e0-4874-8681-19291f95ab7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:43.020708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcd212-e6e0-4874-8681-19291f95ab7b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:43.105209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:43.106413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:43.106413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:43.106694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] PATH_INFO: `/v3/projects/96edba605880462bbd9cbc55c2beea03` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:43.109589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=96edba605880462bbd9cbc55c2beea03)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:43.112487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:43.202383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96edba605880462bbd9cbc55c2beea03', 'request_id': 'req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.204867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:43.219469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96edba605880462bbd9cbc55c2beea03', 'request_id': 'req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.228883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96edba605880462bbd9cbc55c2beea03', 'request_id': 'req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.246604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] The token cache is being invalidate because project 96edba605880462bbd9cbc55c2beea03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:43.246604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.246604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-118e7e5e-ae40-4fc3-b838-5b2a22cf3baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.247621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1050/2099] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:42 2022] DELETE /identity/v3/projects/96edba605880462bbd9cbc55c2beea03 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:43.254726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010de0b-e4c3-4393-81f2-56279ba43610 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:43.256667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2010de0b-e4c3-4393-81f2-56279ba43610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:43.274505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010de0b-e4c3-4393-81f2-56279ba43610 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:43.381879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:43.383007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:43.383481 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:43.383885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] PATH_INFO: `/v3/users/262ffe5887704b37bc8851ee9ce5f94b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:43.387770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=262ffe5887704b37bc8851ee9ce5f94b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:43.390199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:43.487463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262ffe5887704b37bc8851ee9ce5f94b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.488132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262ffe5887704b37bc8851ee9ce5f94b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.489947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:43.508961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262ffe5887704b37bc8851ee9ce5f94b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.521264 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262ffe5887704b37bc8851ee9ce5f94b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.522074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262ffe5887704b37bc8851ee9ce5f94b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:43.556456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1050/2100] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:43 2022] DELETE /identity/v3/users/262ffe5887704b37bc8851ee9ce5f94b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:43.886316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccea08-7c8b-4438-ab61-673bd4745a3d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:43.889192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccea08-7c8b-4438-ab61-673bd4745a3d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:43.889740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccea08-7c8b-4438-ab61-673bd4745a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:43.917289 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d3ccea08-7c8b-4438-ab61-673bd4745a3d None None] MFA Rules not processed for user `a53e967edef644a0a34eac18ff4d9038`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:43.918667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d3ccea08-7c8b-4438-ab61-673bd4745a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:44.044986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1051/2101] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:44.229474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:44.231790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:44.341655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69923e34-46e2-4e10-975c-3741dd0491d5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:44.359702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:44.360515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:44.360839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:44.361502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] PATH_INFO: `/v3/projects/74e98c84e4294442a60d9127e1e1a1c1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:44.365821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e98c84e4294442a60d9127e1e1a1c1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:44.376744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:44.495567 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e98c84e4294442a60d9127e1e1a1c1', 'request_id': 'req-aefd597c-0cc6-4857-aa98-d20c9facb326'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:44.503456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e98c84e4294442a60d9127e1e1a1c1', 'request_id': 'req-aefd597c-0cc6-4857-aa98-d20c9facb326'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:44.513809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e98c84e4294442a60d9127e1e1a1c1', 'request_id': 'req-aefd597c-0cc6-4857-aa98-d20c9facb326'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:44.528588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] The token cache is being invalidate because project 74e98c84e4294442a60d9127e1e1a1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:44.529118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:44.530326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aefd597c-0cc6-4857-aa98-d20c9facb326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:44.532427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1051/2102] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:44 2022] DELETE /identity/v3/projects/74e98c84e4294442a60d9127e1e1a1c1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:44.538848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa071e-7eb8-4f02-84c0-50bc92083f70 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:44.538848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa071e-7eb8-4f02-84c0-50bc92083f70 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:44.539208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa071e-7eb8-4f02-84c0-50bc92083f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:44.563441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1afa071e-7eb8-4f02-84c0-50bc92083f70 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:44.564749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1afa071e-7eb8-4f02-84c0-50bc92083f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:44.660341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1052/2103] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:44.669457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3723-0d24-4042-a969-9330b39fe477 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:44.669658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3723-0d24-4042-a969-9330b39fe477 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:44.669954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc3723-0d24-4042-a969-9330b39fe477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:44.699981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-56dc3723-0d24-4042-a969-9330b39fe477 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:44.701378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-56dc3723-0d24-4042-a969-9330b39fe477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:44.719385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa071e-7eb8-4f02-84c0-50bc92083f70 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:44.727039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1052/2104] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:44.737970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa071e-7eb8-4f02-84c0-50bc92083f70 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:44.747976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003337e-e86e-47eb-bf17-c19b1c8f5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:44.748935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003337e-e86e-47eb-bf17-c19b1c8f5057 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:44.749417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003337e-e86e-47eb-bf17-c19b1c8f5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:44.749845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003337e-e86e-47eb-bf17-c19b1c8f5057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:44.750684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003337e-e86e-47eb-bf17-c19b1c8f5057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:44.751176 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003337e-e86e-47eb-bf17-c19b1c8f5057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:44.756405 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003337e-e86e-47eb-bf17-c19b1c8f5057 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:44.782602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1053/2105] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:44.784221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3723-0d24-4042-a969-9330b39fe477 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:44.833812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc3723-0d24-4042-a969-9330b39fe477 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:44.846689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe114f-6caa-46a8-a266-08bd3702408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:44.848141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe114f-6caa-46a8-a266-08bd3702408f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:44.848723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe114f-6caa-46a8-a266-08bd3702408f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:44.849143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe114f-6caa-46a8-a266-08bd3702408f admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:44.849956 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe114f-6caa-46a8-a266-08bd3702408f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:44.853331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe114f-6caa-46a8-a266-08bd3702408f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:44.899339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003337e-e86e-47eb-bf17-c19b1c8f5057 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:44.900443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1053/2106] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:44 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:44.912078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003337e-e86e-47eb-bf17-c19b1c8f5057 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:45.036381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89853be-7e5c-43a4-9046-f8b9b65f2eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:45.037228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89853be-7e5c-43a4-9046-f8b9b65f2eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:45.037693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89853be-7e5c-43a4-9046-f8b9b65f2eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:45.038139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89853be-7e5c-43a4-9046-f8b9b65f2eeb admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:45.039116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89853be-7e5c-43a4-9046-f8b9b65f2eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:45.041909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89853be-7e5c-43a4-9046-f8b9b65f2eeb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:45.070013 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:45.084909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1054/2107] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:44 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:45.086463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe114f-6caa-46a8-a266-08bd3702408f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:45.113349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe114f-6caa-46a8-a266-08bd3702408f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:45.136731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d742b-0d17-4120-a4a6-7af3f21e301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:45.137492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d742b-0d17-4120-a4a6-7af3f21e301c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:45.138016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d742b-0d17-4120-a4a6-7af3f21e301c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:45.138445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d742b-0d17-4120-a4a6-7af3f21e301c admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:45.146262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d742b-0d17-4120-a4a6-7af3f21e301c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:45.155521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d742b-0d17-4120-a4a6-7af3f21e301c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:45.174039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1054/2108] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:45.178139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89853be-7e5c-43a4-9046-f8b9b65f2eeb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:45.190196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89853be-7e5c-43a4-9046-f8b9b65f2eeb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:45.196618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45e750-aa36-44fc-accf-c93109820ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:45.198053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45e750-aa36-44fc-accf-c93109820ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:45.198643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45e750-aa36-44fc-accf-c93109820ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:45.199049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45e750-aa36-44fc-accf-c93109820ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:45.199854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45e750-aa36-44fc-accf-c93109820ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:45.201889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45e750-aa36-44fc-accf-c93109820ae2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:45.221011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1055/2109] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:45.225003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d742b-0d17-4120-a4a6-7af3f21e301c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:45.248171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d742b-0d17-4120-a4a6-7af3f21e301c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:45.267093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e73ac-7a71-4a72-a1ee-9927f1333a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:45.267967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e73ac-7a71-4a72-a1ee-9927f1333a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:45.270978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e73ac-7a71-4a72-a1ee-9927f1333a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:45.271444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e73ac-7a71-4a72-a1ee-9927f1333a75 admin admin] PATH_INFO: `/v3/projects/baf7f5df078f4affa9a3906c18a34ee5/users/b516657b3ebf4f3ab396679a2730c05a/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:45.293646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:45.298491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e73ac-7a71-4a72-a1ee-9927f1333a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf7f5df078f4affa9a3906c18a34ee5, user_id=b516657b3ebf4f3ab396679a2730c05a, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:45.301711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e73ac-7a71-4a72-a1ee-9927f1333a75 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:45.339399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1055/2110] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:45 2022] PUT /identity/v3/projects/baf7f5df078f4affa9a3906c18a34ee5/users/b516657b3ebf4f3ab396679a2730c05a/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:45.345593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502c2b7-41c0-4b7b-8ade-db64631e8733 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:45.346128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502c2b7-41c0-4b7b-8ade-db64631e8733 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:45.346561 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502c2b7-41c0-4b7b-8ade-db64631e8733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:45.450090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7502c2b7-41c0-4b7b-8ade-db64631e8733 None None] MFA Rules not processed for user `b516657b3ebf4f3ab396679a2730c05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:45.451853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7502c2b7-41c0-4b7b-8ade-db64631e8733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:45.649818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1056/2111] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:45.655844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e73ac-7a71-4a72-a1ee-9927f1333a75 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:45.825339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e73ac-7a71-4a72-a1ee-9927f1333a75 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:45.833337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be3408-8546-4864-a096-d196998e1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:45.833968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3408-8546-4864-a096-d196998e1fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:45.834298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3408-8546-4864-a096-d196998e1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:45.834803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3408-8546-4864-a096-d196998e1fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:45.835603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be3408-8546-4864-a096-d196998e1fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:45.837897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be3408-8546-4864-a096-d196998e1fa2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:45.903364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502c2b7-41c0-4b7b-8ade-db64631e8733 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:45.904112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1056/2112] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:45 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:45.916939 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502c2b7-41c0-4b7b-8ade-db64631e8733 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:46.044122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a48e99-6185-4744-99dd-c8052e3a1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:46.044952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a48e99-6185-4744-99dd-c8052e3a1e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:46.045402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a48e99-6185-4744-99dd-c8052e3a1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:46.046024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a48e99-6185-4744-99dd-c8052e3a1e86 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:46.046834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a48e99-6185-4744-99dd-c8052e3a1e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:46.049017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a48e99-6185-4744-99dd-c8052e3a1e86 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:46.095363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1057/2113] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:45 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:46.100370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be3408-8546-4864-a096-d196998e1fa2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:46.114959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be3408-8546-4864-a096-d196998e1fa2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:46.122933 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b5beb-4b0a-458b-b8bf-28e04ee5c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:46.123738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b5beb-4b0a-458b-b8bf-28e04ee5c58a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:46.124023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b5beb-4b0a-458b-b8bf-28e04ee5c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:46.124670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b5beb-4b0a-458b-b8bf-28e04ee5c58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:46.125440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b5beb-4b0a-458b-b8bf-28e04ee5c58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:46.127159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b5beb-4b0a-458b-b8bf-28e04ee5c58a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:46.154943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a48e99-6185-4744-99dd-c8052e3a1e86 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:46.159492 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1057/2114] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:46.172665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a48e99-6185-4744-99dd-c8052e3a1e86 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:46.184310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245af78-62e0-45ae-be7a-861f52d63b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:46.185362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245af78-62e0-45ae-be7a-861f52d63b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:46.193137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245af78-62e0-45ae-be7a-861f52d63b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:46.193650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245af78-62e0-45ae-be7a-861f52d63b97 admin admin] PATH_INFO: `/v3/projects/3982866b5beb42abb52a7ea3c5d1c893/users/01b2c1eed4c14d3083018a003a2d5f53/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:46.226517 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245af78-62e0-45ae-be7a-861f52d63b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3982866b5beb42abb52a7ea3c5d1c893, user_id=01b2c1eed4c14d3083018a003a2d5f53, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:46.230438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245af78-62e0-45ae-be7a-861f52d63b97 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:46.258897 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1058/2115] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:46 2022] PUT /identity/v3/projects/3982866b5beb42abb52a7ea3c5d1c893/users/01b2c1eed4c14d3083018a003a2d5f53/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:46.262766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b5beb-4b0a-458b-b8bf-28e04ee5c58a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:46.286504 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b5beb-4b0a-458b-b8bf-28e04ee5c58a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:46.398647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a6073-1658-4823-80da-16940e5fdefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:46.399510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a6073-1658-4823-80da-16940e5fdefd admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:46.399857 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a6073-1658-4823-80da-16940e5fdefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:46.400231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a6073-1658-4823-80da-16940e5fdefd admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:46.401007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a6073-1658-4823-80da-16940e5fdefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:46.403085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a6073-1658-4823-80da-16940e5fdefd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:46.415646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1058/2116] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:46.419851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245af78-62e0-45ae-be7a-861f52d63b97 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:46.432450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245af78-62e0-45ae-be7a-861f52d63b97 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:46.448085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe517d-dfb7-45dc-bf4e-0c7e461785be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:46.450227 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe517d-dfb7-45dc-bf4e-0c7e461785be admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:46.450810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe517d-dfb7-45dc-bf4e-0c7e461785be admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:46.451260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe517d-dfb7-45dc-bf4e-0c7e461785be admin admin] PATH_INFO: `/v3/projects/3982866b5beb42abb52a7ea3c5d1c893/users/01b2c1eed4c14d3083018a003a2d5f53/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:46.453967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe517d-dfb7-45dc-bf4e-0c7e461785be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3982866b5beb42abb52a7ea3c5d1c893, user_id=01b2c1eed4c14d3083018a003a2d5f53, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:46.457355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe517d-dfb7-45dc-bf4e-0c7e461785be admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:46.482041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1059/2117] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:46 2022] PUT /identity/v3/projects/3982866b5beb42abb52a7ea3c5d1c893/users/01b2c1eed4c14d3083018a003a2d5f53/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:46.485017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f410396-5d4c-474a-b854-a368e3e5e0fe None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:46.485482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f410396-5d4c-474a-b854-a368e3e5e0fe None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:46.485798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f410396-5d4c-474a-b854-a368e3e5e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:46.524858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6f410396-5d4c-474a-b854-a368e3e5e0fe None None] MFA Rules not processed for user `01b2c1eed4c14d3083018a003a2d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:46.526535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6f410396-5d4c-474a-b854-a368e3e5e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:46.631918 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:46.662183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1059/2118] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:46.673217 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe517d-dfb7-45dc-bf4e-0c7e461785be admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:46.680132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8dbe517d-dfb7-45dc-bf4e-0c7e461785be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:46.759859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:46.788902 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe517d-dfb7-45dc-bf4e-0c7e461785be admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:46.793759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedf89e-ca4f-4cea-b56c-ea961150ddf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:46.794379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf89e-ca4f-4cea-b56c-ea961150ddf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:46.794681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf89e-ca4f-4cea-b56c-ea961150ddf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:46.794954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf89e-ca4f-4cea-b56c-ea961150ddf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:46.806369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedf89e-ca4f-4cea-b56c-ea961150ddf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:46.808485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedf89e-ca4f-4cea-b56c-ea961150ddf3 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:46.824621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1060/2119] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:48.398845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f410396-5d4c-474a-b854-a368e3e5e0fe None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:48.558071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f410396-5d4c-474a-b854-a368e3e5e0fe None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:48.568593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:48.569510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:48.569799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:48.570104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] PATH_INFO: `/v3/users/b516657b3ebf4f3ab396679a2730c05a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:48.572643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b516657b3ebf4f3ab396679a2730c05a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:48.574937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:48.696682 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b516657b3ebf4f3ab396679a2730c05a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:48.697390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b516657b3ebf4f3ab396679a2730c05a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:48.729773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b516657b3ebf4f3ab396679a2730c05a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:48.752535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b516657b3ebf4f3ab396679a2730c05a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:48.762054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b516657b3ebf4f3ab396679a2730c05a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:48.789603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1060/2120] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:48 2022] DELETE /identity/v3/users/b516657b3ebf4f3ab396679a2730c05a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:48.794433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2fac8-1017-43a1-8719-4b15726888cc None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:48.794950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2fac8-1017-43a1-8719-4b15726888cc None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:48.795114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2fac8-1017-43a1-8719-4b15726888cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:48.836728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-10c2fac8-1017-43a1-8719-4b15726888cc None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:48.837971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-10c2fac8-1017-43a1-8719-4b15726888cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:49.052754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1061/2121] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:49.091084 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:49.094584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:49.240416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2816aec-91bc-4398-9fd2-a320ee2fac2b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:49.246555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563c9fb-e3ce-4dd2-b2fd-9794e2926317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:49.247473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563c9fb-e3ce-4dd2-b2fd-9794e2926317 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:49.247914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563c9fb-e3ce-4dd2-b2fd-9794e2926317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:49.248187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563c9fb-e3ce-4dd2-b2fd-9794e2926317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:49.261296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563c9fb-e3ce-4dd2-b2fd-9794e2926317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:49.262884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563c9fb-e3ce-4dd2-b2fd-9794e2926317 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:49.282790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1061/2122] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:49.694905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2fac8-1017-43a1-8719-4b15726888cc None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:49.696388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-10c2fac8-1017-43a1-8719-4b15726888cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:49.724130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2fac8-1017-43a1-8719-4b15726888cc None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:49.750893 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:49.780735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:49.781078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:49.781362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] PATH_INFO: `/v3/users/cdee72173dba44bfb30ae744e869638f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:49.785218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdee72173dba44bfb30ae744e869638f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:49.799610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:49.941981 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdee72173dba44bfb30ae744e869638f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:49.945393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdee72173dba44bfb30ae744e869638f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:49.969478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdee72173dba44bfb30ae744e869638f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:49.980026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdee72173dba44bfb30ae744e869638f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:50.002594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdee72173dba44bfb30ae744e869638f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:50.022770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1062/2123] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:49 2022] DELETE /identity/v3/users/cdee72173dba44bfb30ae744e869638f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:50.028058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c429-7a3d-4a3c-861b-18485bb11fc1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:50.029456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c429-7a3d-4a3c-861b-18485bb11fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:50.029950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c429-7a3d-4a3c-861b-18485bb11fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:50.069699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1853c429-7a3d-4a3c-861b-18485bb11fc1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:50.072788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1853c429-7a3d-4a3c-861b-18485bb11fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:50.092783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:50.286530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1062/2124] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:50.327591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:50.329171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:50.479732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:50.486141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f469a9a-6561-430f-a5d2-332ba89b9891 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:50.507358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f30a3-8ac1-4ba9-b4ad-2116d19b6d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:50.509540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f30a3-8ac1-4ba9-b4ad-2116d19b6d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:50.509832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f30a3-8ac1-4ba9-b4ad-2116d19b6d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:50.512131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f30a3-8ac1-4ba9-b4ad-2116d19b6d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:50.551836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f30a3-8ac1-4ba9-b4ad-2116d19b6d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:50.554960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f30a3-8ac1-4ba9-b4ad-2116d19b6d0c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:50.583595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1063/2125] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:50.748645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853c429-7a3d-4a3c-861b-18485bb11fc1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:50.750155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1853c429-7a3d-4a3c-861b-18485bb11fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:50.784971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853c429-7a3d-4a3c-861b-18485bb11fc1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:50.802510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:50.803407 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:50.803818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:50.804184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] PATH_INFO: `/v3/projects/baf7f5df078f4affa9a3906c18a34ee5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:50.807160 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf7f5df078f4affa9a3906c18a34ee5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:50.830702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:50.937632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf7f5df078f4affa9a3906c18a34ee5', 'request_id': 'req-bb78e043-12cd-49d6-9c57-e24d539c07fd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:50.945427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf7f5df078f4affa9a3906c18a34ee5', 'request_id': 'req-bb78e043-12cd-49d6-9c57-e24d539c07fd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:50.959660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf7f5df078f4affa9a3906c18a34ee5', 'request_id': 'req-bb78e043-12cd-49d6-9c57-e24d539c07fd'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:50.975486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] The token cache is being invalidate because project baf7f5df078f4affa9a3906c18a34ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:50.975905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:50.976686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb78e043-12cd-49d6-9c57-e24d539c07fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:50.981967 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1063/2126] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:50 2022] DELETE /identity/v3/projects/baf7f5df078f4affa9a3906c18a34ee5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:50.982675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f30a3-8ac1-4ba9-b4ad-2116d19b6d0c service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:50.994459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f30a3-8ac1-4ba9-b4ad-2116d19b6d0c service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:51.120839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:51.121717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:51.122138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:51.122512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] PATH_INFO: `/v3/users/01b2c1eed4c14d3083018a003a2d5f53` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:51.124202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b2c1eed4c14d3083018a003a2d5f53)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:51.128818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:51.214348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b2c1eed4c14d3083018a003a2d5f53'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:51.215415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b2c1eed4c14d3083018a003a2d5f53'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:51.235713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b2c1eed4c14d3083018a003a2d5f53'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:51.247298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b2c1eed4c14d3083018a003a2d5f53'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:51.276963 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b2c1eed4c14d3083018a003a2d5f53'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:51.299594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1064/2127] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:50 2022] DELETE /identity/v3/users/01b2c1eed4c14d3083018a003a2d5f53 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:51.443178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff459c-54a2-4624-80a5-5982f0098b5b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:51.443995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff459c-54a2-4624-80a5-5982f0098b5b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:51.444453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff459c-54a2-4624-80a5-5982f0098b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:51.521738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-46ff459c-54a2-4624-80a5-5982f0098b5b None None] MFA Rules not processed for user `e2cd2758dd5e4e6a88363e5a22550289`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:51.523505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-46ff459c-54a2-4624-80a5-5982f0098b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:51.665351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:51.667422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:51.670357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1064/2128] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:51.776821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a19f9-c44b-47f9-b410-b8c54633c988 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:51.788303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:51.789351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:51.790267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:51.790736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] PATH_INFO: `/v3/projects/47dd3534c5fc49c8afdd89bd3d795c08` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:51.792555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47dd3534c5fc49c8afdd89bd3d795c08)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:51.795059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:51.833744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:51.883792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff459c-54a2-4624-80a5-5982f0098b5b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:51.885638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-46ff459c-54a2-4624-80a5-5982f0098b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:51.937468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:51.970457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47dd3534c5fc49c8afdd89bd3d795c08', 'request_id': 'req-1d3986d6-0814-4cf5-b028-88e7dc1829d8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:51.992700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47dd3534c5fc49c8afdd89bd3d795c08', 'request_id': 'req-1d3986d6-0814-4cf5-b028-88e7dc1829d8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.010313 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47dd3534c5fc49c8afdd89bd3d795c08', 'request_id': 'req-1d3986d6-0814-4cf5-b028-88e7dc1829d8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.058586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] The token cache is being invalidate because project 47dd3534c5fc49c8afdd89bd3d795c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:52.060385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.061734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.074569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1065/2129] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:51 2022] DELETE /identity/v3/projects/47dd3534c5fc49c8afdd89bd3d795c08 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:52.076244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:52.078459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff459c-54a2-4624-80a5-5982f0098b5b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:52.080420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:52.218905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:52.219577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:52.219858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:52.220130 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:52.223543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:52.236365 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3986d6-0814-4cf5-b028-88e7dc1829d8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:52.250354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:52.251809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:52.252105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:52.254060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] PATH_INFO: `/v3/users/b466b5b2d0fd437db4e2fa136a7f2fb1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:52.256903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b466b5b2d0fd437db4e2fa136a7f2fb1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:52.258950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:52.420567 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:52.427743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:52.428901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b466b5b2d0fd437db4e2fa136a7f2fb1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.431452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b466b5b2d0fd437db4e2fa136a7f2fb1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.443157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1065/2130] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:52.444074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:52.447786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:52.467284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b466b5b2d0fd437db4e2fa136a7f2fb1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.475656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810bbec-438b-4b2f-b06d-71eddb1002a2 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:52.477279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b466b5b2d0fd437db4e2fa136a7f2fb1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.484530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:52.487838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:52.490068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:52.490489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-426f1793-cc4c-4274-b01f-5be21bd7b47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b466b5b2d0fd437db4e2fa136a7f2fb1'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.491500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] PATH_INFO: `/v3/projects/3982866b5beb42abb52a7ea3c5d1c893` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:52.494627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3982866b5beb42abb52a7ea3c5d1c893)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:52.498714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:52.512327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1066/2131] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:52 2022] DELETE /identity/v3/users/b466b5b2d0fd437db4e2fa136a7f2fb1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:52.600395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:52.602125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3982866b5beb42abb52a7ea3c5d1c893', 'request_id': 'req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.616938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3982866b5beb42abb52a7ea3c5d1c893', 'request_id': 'req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.635385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3982866b5beb42abb52a7ea3c5d1c893', 'request_id': 'req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.662940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] The token cache is being invalidate because project 3982866b5beb42abb52a7ea3c5d1c893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:52.663757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.665339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd3f423a-2eb5-44d9-8c8f-f4667c3f4e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:52.668524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1066/2132] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:52 2022] DELETE /identity/v3/projects/3982866b5beb42abb52a7ea3c5d1c893 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:52.677316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a05fc-0ec0-44e0-a630-61adf6c7a2da None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:52.677633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a05fc-0ec0-44e0-a630-61adf6c7a2da None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:52.678074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a05fc-0ec0-44e0-a630-61adf6c7a2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:52.714612 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a94a05fc-0ec0-44e0-a630-61adf6c7a2da None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:52.716068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a94a05fc-0ec0-44e0-a630-61adf6c7a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:52.761104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:52.823128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1067/2133] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:52.830217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633235fa-3173-4931-93e4-a9917bc0c3d8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:52.830505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633235fa-3173-4931-93e4-a9917bc0c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:52.830783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633235fa-3173-4931-93e4-a9917bc0c3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:52.854857 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-633235fa-3173-4931-93e4-a9917bc0c3d8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:52.856331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-633235fa-3173-4931-93e4-a9917bc0c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:52.866521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1067/2134] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:52.873185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a05fc-0ec0-44e0-a630-61adf6c7a2da None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:52.886248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a05fc-0ec0-44e0-a630-61adf6c7a2da None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:52.895668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffd31c-8b33-4348-b7f2-65af58042a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:52.896689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffd31c-8b33-4348-b7f2-65af58042a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:52.897157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffd31c-8b33-4348-b7f2-65af58042a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:52.898379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffd31c-8b33-4348-b7f2-65af58042a40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:52.899403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffd31c-8b33-4348-b7f2-65af58042a40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:52.899951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffd31c-8b33-4348-b7f2-65af58042a40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:52.901854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffd31c-8b33-4348-b7f2-65af58042a40 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:52.929880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1068/2135] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:52.934148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633235fa-3173-4931-93e4-a9917bc0c3d8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:52.946002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633235fa-3173-4931-93e4-a9917bc0c3d8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:52.953409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d505e-65cc-448d-af02-e439b0800af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:52.955314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d505e-65cc-448d-af02-e439b0800af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:52.955760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d505e-65cc-448d-af02-e439b0800af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:52.956033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d505e-65cc-448d-af02-e439b0800af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:52.957544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d505e-65cc-448d-af02-e439b0800af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:52.963427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d505e-65cc-448d-af02-e439b0800af0 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:53.012295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1068/2136] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:52 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:53.014237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffd31c-8b33-4348-b7f2-65af58042a40 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:53.026791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffd31c-8b33-4348-b7f2-65af58042a40 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:53.057784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d505e-65cc-448d-af02-e439b0800af0 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:53.059856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a72d505e-65cc-448d-af02-e439b0800af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:53.162158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d505e-65cc-448d-af02-e439b0800af0 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:53.166554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9af443-ac8f-40e5-bb8e-23cd02e996e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:53.167617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9af443-ac8f-40e5-bb8e-23cd02e996e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.168042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9af443-ac8f-40e5-bb8e-23cd02e996e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.168867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9af443-ac8f-40e5-bb8e-23cd02e996e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.169182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:53.169900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9af443-ac8f-40e5-bb8e-23cd02e996e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:53.170022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.171947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.172352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] PATH_INFO: `/v3/projects/52556103237b4be19ffcba7c6c1344b7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.174090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52556103237b4be19ffcba7c6c1344b7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:53.174499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9af443-ac8f-40e5-bb8e-23cd02e996e5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:53.176268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:53.223296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1069/2137] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:53 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:53.228635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9af443-ac8f-40e5-bb8e-23cd02e996e5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:53.241655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9af443-ac8f-40e5-bb8e-23cd02e996e5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:53.266804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52556103237b4be19ffcba7c6c1344b7', 'request_id': 'req-85e367db-eb3c-42f1-af04-b70d932b824d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:53.291832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52556103237b4be19ffcba7c6c1344b7', 'request_id': 'req-85e367db-eb3c-42f1-af04-b70d932b824d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:53.308803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52556103237b4be19ffcba7c6c1344b7', 'request_id': 'req-85e367db-eb3c-42f1-af04-b70d932b824d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:53.328606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] The token cache is being invalidate because project 52556103237b4be19ffcba7c6c1344b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:53.328912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:53.332185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-85e367db-eb3c-42f1-af04-b70d932b824d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:53.336654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1069/2138] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:53 2022] DELETE /identity/v3/projects/52556103237b4be19ffcba7c6c1344b7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:53.341187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d8847-cf9b-4990-abf4-c257bf805605 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.341480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d8847-cf9b-4990-abf4-c257bf805605 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.341762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d8847-cf9b-4990-abf4-c257bf805605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.393309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ba6d8847-cf9b-4990-abf4-c257bf805605 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:53.395593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ba6d8847-cf9b-4990-abf4-c257bf805605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:53.422729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e79aa-1905-42ce-81ae-085558c9474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:53.423413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e79aa-1905-42ce-81ae-085558c9474d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.423854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e79aa-1905-42ce-81ae-085558c9474d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.424637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e79aa-1905-42ce-81ae-085558c9474d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.424869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e79aa-1905-42ce-81ae-085558c9474d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:53.426511 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e79aa-1905-42ce-81ae-085558c9474d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:53.447276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1070/2139] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:53.451780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e79aa-1905-42ce-81ae-085558c9474d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:53.454054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1f4e79aa-1905-42ce-81ae-085558c9474d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:53.457676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:53.491241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1070/2140] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:53.500274 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c535b-99d1-4e0f-a3bd-17d9f40aed3a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.500274 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c535b-99d1-4e0f-a3bd-17d9f40aed3a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.500520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c535b-99d1-4e0f-a3bd-17d9f40aed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.501328 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e79aa-1905-42ce-81ae-085558c9474d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:53.507811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585eedf-95c0-4455-a720-ee309503876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:53.508776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585eedf-95c0-4455-a720-ee309503876a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.509109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585eedf-95c0-4455-a720-ee309503876a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.509391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585eedf-95c0-4455-a720-ee309503876a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.510199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585eedf-95c0-4455-a720-ee309503876a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:53.512213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585eedf-95c0-4455-a720-ee309503876a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:53.532943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5b2c535b-99d1-4e0f-a3bd-17d9f40aed3a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:53.535395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1071/2141] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:53.537443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5b2c535b-99d1-4e0f-a3bd-17d9f40aed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:53.540006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585eedf-95c0-4455-a720-ee309503876a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:53.548415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1071/2142] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:53.555177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c535b-99d1-4e0f-a3bd-17d9f40aed3a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:53.558533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585eedf-95c0-4455-a720-ee309503876a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:53.571680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c535b-99d1-4e0f-a3bd-17d9f40aed3a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:53.575901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606046-d469-47f7-87bd-1c8c73a59617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:53.581761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606046-d469-47f7-87bd-1c8c73a59617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.582702 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606046-d469-47f7-87bd-1c8c73a59617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.583330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606046-d469-47f7-87bd-1c8c73a59617 admin admin] PATH_INFO: `/v3/projects/db3167f6eaa047a398fa1065656451b1/users/53d8f720ad8b4b98951973ad892dd059/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.599990 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c5c67-622b-43bb-9286-80746e81f4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:53.600733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c5c67-622b-43bb-9286-80746e81f4ac admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.601022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c5c67-622b-43bb-9286-80746e81f4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.601311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c5c67-622b-43bb-9286-80746e81f4ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.608235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c5c67-622b-43bb-9286-80746e81f4ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:53.608630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c5c67-622b-43bb-9286-80746e81f4ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:53.610268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c5c67-622b-43bb-9286-80746e81f4ac admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:53.641132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f606046-d469-47f7-87bd-1c8c73a59617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3167f6eaa047a398fa1065656451b1, user_id=53d8f720ad8b4b98951973ad892dd059, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:53.644547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f606046-d469-47f7-87bd-1c8c73a59617 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:53.646550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1072/2143] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:53.647502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c5c67-622b-43bb-9286-80746e81f4ac admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:53.653076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:53.667468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c5c67-622b-43bb-9286-80746e81f4ac admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:53.686635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1072/2144] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:53 2022] PUT /identity/v3/projects/db3167f6eaa047a398fa1065656451b1/users/53d8f720ad8b4b98951973ad892dd059/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:53.701747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87849d-6217-4038-a2a5-76b3782ece63 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.703782 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87849d-6217-4038-a2a5-76b3782ece63 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.704195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87849d-6217-4038-a2a5-76b3782ece63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.780231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1b87849d-6217-4038-a2a5-76b3782ece63 None None] MFA Rules not processed for user `53d8f720ad8b4b98951973ad892dd059`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:53.781473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b87849d-6217-4038-a2a5-76b3782ece63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:53.809588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272f051-5c5e-450b-ab83-8229774eb642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:53.810804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f051-5c5e-450b-ab83-8229774eb642 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:53.811157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f051-5c5e-450b-ab83-8229774eb642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:53.811434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f051-5c5e-450b-ab83-8229774eb642 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:53.813220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272f051-5c5e-450b-ab83-8229774eb642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:53.817813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272f051-5c5e-450b-ab83-8229774eb642 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:53.869221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1073/2145] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:53 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:53.874769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272f051-5c5e-450b-ab83-8229774eb642 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:53.939405 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1073/2146] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:53.960531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87849d-6217-4038-a2a5-76b3782ece63 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:53.967516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b87849d-6217-4038-a2a5-76b3782ece63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:54.000191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272f051-5c5e-450b-ab83-8229774eb642 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:54.011787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a23216-5245-4af6-9720-3a904ab47e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:54.013252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a23216-5245-4af6-9720-3a904ab47e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:54.015686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a23216-5245-4af6-9720-3a904ab47e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:54.016697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a23216-5245-4af6-9720-3a904ab47e69 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:54.019904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a23216-5245-4af6-9720-3a904ab47e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:54.023493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a23216-5245-4af6-9720-3a904ab47e69 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:54.078051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1074/2147] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:53 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:41:54.082316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a23216-5245-4af6-9720-3a904ab47e69 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:54.120171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a23216-5245-4af6-9720-3a904ab47e69 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:54.135856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cda43-65fa-4b8e-bca6-f8e7060709c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:54.137486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cda43-65fa-4b8e-bca6-f8e7060709c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:54.137486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cda43-65fa-4b8e-bca6-f8e7060709c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:54.137486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cda43-65fa-4b8e-bca6-f8e7060709c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:54.137817 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cda43-65fa-4b8e-bca6-f8e7060709c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:54.143119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cda43-65fa-4b8e-bca6-f8e7060709c1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:54.171648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1075/2148] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:54.175853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cda43-65fa-4b8e-bca6-f8e7060709c1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:54.194468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cda43-65fa-4b8e-bca6-f8e7060709c1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:54.201297 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807086a9-1850-448b-a125-4a858a118460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:54.202036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807086a9-1850-448b-a125-4a858a118460 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:54.203096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807086a9-1850-448b-a125-4a858a118460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:54.203408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807086a9-1850-448b-a125-4a858a118460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:54.204110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807086a9-1850-448b-a125-4a858a118460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:54.206566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807086a9-1850-448b-a125-4a858a118460 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:54.214205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87849d-6217-4038-a2a5-76b3782ece63 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:54.222495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1076/2149] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:54.227166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807086a9-1850-448b-a125-4a858a118460 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:54.244798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807086a9-1850-448b-a125-4a858a118460 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:54.251593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392de64c-8dfb-4b30-b472-539859bbf0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:54.265707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de64c-8dfb-4b30-b472-539859bbf0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:54.266912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de64c-8dfb-4b30-b472-539859bbf0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:54.269038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392de64c-8dfb-4b30-b472-539859bbf0e8 admin admin] PATH_INFO: `/v3/projects/76920c8107d94e429c578752addb3f86/users/f4d96024207447ab8094dbd6fca71922/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:54.291742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:54.298310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40c52c-d4a7-4789-97b0-c59611818d28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955c6cb8893c473fadd028b12bbea69d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:54.299093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c52c-d4a7-4789-97b0-c59611818d28 service glance] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:54.299489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c52c-d4a7-4789-97b0-c59611818d28 service glance] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:54.301225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c52c-d4a7-4789-97b0-c59611818d28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:54.313635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392de64c-8dfb-4b30-b472-539859bbf0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76920c8107d94e429c578752addb3f86, user_id=f4d96024207447ab8094dbd6fca71922, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:54.317765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392de64c-8dfb-4b30-b472-539859bbf0e8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:54.374624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1077/2150] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:54 2022] PUT /identity/v3/projects/76920c8107d94e429c578752addb3f86/users/f4d96024207447ab8094dbd6fca71922/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:54.385886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c500c3-fda0-498f-bc2c-34c5881fbbe3 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:54.386144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c500c3-fda0-498f-bc2c-34c5881fbbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:54.386424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c500c3-fda0-498f-bc2c-34c5881fbbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:54.395172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:54.428316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40c52c-d4a7-4789-97b0-c59611818d28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:54.430916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40c52c-d4a7-4789-97b0-c59611818d28 service glance] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:54.450335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1074/2151] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:54.456419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c0c500c3-fda0-498f-bc2c-34c5881fbbe3 None None] MFA Rules not processed for user `f4d96024207447ab8094dbd6fca71922`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:54.458364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c0c500c3-fda0-498f-bc2c-34c5881fbbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:54.634671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1078/2152] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:54.636339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40c52c-d4a7-4789-97b0-c59611818d28 service glance] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:54.656448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40c52c-d4a7-4789-97b0-c59611818d28 service glance] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:54.765974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78523d15-ef50-4270-a6a1-8965d1ce1631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:54.767062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523d15-ef50-4270-a6a1-8965d1ce1631 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:54.767487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523d15-ef50-4270-a6a1-8965d1ce1631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:54.768144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523d15-ef50-4270-a6a1-8965d1ce1631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:54.769466 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78523d15-ef50-4270-a6a1-8965d1ce1631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:54.773686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78523d15-ef50-4270-a6a1-8965d1ce1631 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:54.790414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d605a9-0251-41b1-97dc-7ec05ec995d0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:54.791079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d605a9-0251-41b1-97dc-7ec05ec995d0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:54.791343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d605a9-0251-41b1-97dc-7ec05ec995d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:54.841520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b1d605a9-0251-41b1-97dc-7ec05ec995d0 None None] MFA Rules not processed for user `0d7a82606b784b43b2dc634b1418348a`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:54.842761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b1d605a9-0251-41b1-97dc-7ec05ec995d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:54.859303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1075/2153] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:54 2022] POST /identity/v3/projects => generated 369 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:54.861111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78523d15-ef50-4270-a6a1-8965d1ce1631 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:55.001566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78523d15-ef50-4270-a6a1-8965d1ce1631 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:55.002417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1079/2154] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:55.018930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ed73-8b05-48b5-b3a2-f42c6861d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:55.019596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ed73-8b05-48b5-b3a2-f42c6861d053 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:55.019879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ed73-8b05-48b5-b3a2-f42c6861d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:55.020174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8ed73-8b05-48b5-b3a2-f42c6861d053 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:55.021028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8ed73-8b05-48b5-b3a2-f42c6861d053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:55.022978 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8ed73-8b05-48b5-b3a2-f42c6861d053 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:55.057439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1076/2155] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:54 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:55.058574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d605a9-0251-41b1-97dc-7ec05ec995d0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:55.070912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d605a9-0251-41b1-97dc-7ec05ec995d0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:55.080272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382726c-c454-42ea-9760-8af2ea66d4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:55.080905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382726c-c454-42ea-9760-8af2ea66d4da admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:55.081702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382726c-c454-42ea-9760-8af2ea66d4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:55.081971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382726c-c454-42ea-9760-8af2ea66d4da admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:55.082667 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382726c-c454-42ea-9760-8af2ea66d4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:55.084293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382726c-c454-42ea-9760-8af2ea66d4da admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:55.099958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1080/2156] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:41:55.101766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ed73-8b05-48b5-b3a2-f42c6861d053 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:55.112818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8ed73-8b05-48b5-b3a2-f42c6861d053 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:55.120586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68880b46-f645-4702-8d34-0a8bc831c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:55.121752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880b46-f645-4702-8d34-0a8bc831c4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:55.122021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880b46-f645-4702-8d34-0a8bc831c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:55.122343 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68880b46-f645-4702-8d34-0a8bc831c4d4 admin admin] PATH_INFO: `/v3/projects/ae5cc0aba9ca43df870021d9a78420ef/users/651c52e363b847cda5c6de7a1f9f23e6/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:55.144144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68880b46-f645-4702-8d34-0a8bc831c4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5cc0aba9ca43df870021d9a78420ef, user_id=651c52e363b847cda5c6de7a1f9f23e6, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:55.147471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68880b46-f645-4702-8d34-0a8bc831c4d4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:55.178263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1077/2157] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:55 2022] PUT /identity/v3/projects/ae5cc0aba9ca43df870021d9a78420ef/users/651c52e363b847cda5c6de7a1f9f23e6/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:55.204197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382726c-c454-42ea-9760-8af2ea66d4da admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:55.231916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382726c-c454-42ea-9760-8af2ea66d4da admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:55.401209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf15c80-90fc-4212-8df0-4229e820731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:55.402128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf15c80-90fc-4212-8df0-4229e820731b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:55.402739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf15c80-90fc-4212-8df0-4229e820731b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:55.403145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf15c80-90fc-4212-8df0-4229e820731b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:55.404386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf15c80-90fc-4212-8df0-4229e820731b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:55.408030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf15c80-90fc-4212-8df0-4229e820731b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:55.438115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1081/2158] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:41:55.438661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68880b46-f645-4702-8d34-0a8bc831c4d4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:55.472432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68880b46-f645-4702-8d34-0a8bc831c4d4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:55.479282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd48d98-df35-462d-85c7-fb0b3605d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:55.480020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48d98-df35-462d-85c7-fb0b3605d541 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:55.480332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48d98-df35-462d-85c7-fb0b3605d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:55.481192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48d98-df35-462d-85c7-fb0b3605d541 admin admin] PATH_INFO: `/v3/projects/ae5cc0aba9ca43df870021d9a78420ef/users/651c52e363b847cda5c6de7a1f9f23e6/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:55.483990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd48d98-df35-462d-85c7-fb0b3605d541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5cc0aba9ca43df870021d9a78420ef, user_id=651c52e363b847cda5c6de7a1f9f23e6, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:55.487639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd48d98-df35-462d-85c7-fb0b3605d541 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:55.505039 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1078/2159] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:41:55 2022] PUT /identity/v3/projects/ae5cc0aba9ca43df870021d9a78420ef/users/651c52e363b847cda5c6de7a1f9f23e6/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:41:55.516821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3a76c-3825-418f-bd0b-840a56d8cf48 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:55.517359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3a76c-3825-418f-bd0b-840a56d8cf48 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:55.517359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3a76c-3825-418f-bd0b-840a56d8cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:55.539003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:55.569709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e7b3a76c-3825-418f-bd0b-840a56d8cf48 None None] MFA Rules not processed for user `651c52e363b847cda5c6de7a1f9f23e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:55.571578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e7b3a76c-3825-418f-bd0b-840a56d8cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:55.710604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1082/2160] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:55.727089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd48d98-df35-462d-85c7-fb0b3605d541 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:55.729206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-efd48d98-df35-462d-85c7-fb0b3605d541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:55.763881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:55.876922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd48d98-df35-462d-85c7-fb0b3605d541 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:55.899145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56111d-8604-4180-b84a-e34c6cd86dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:55.901314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56111d-8604-4180-b84a-e34c6cd86dbf service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:55.902416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56111d-8604-4180-b84a-e34c6cd86dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:55.903634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56111d-8604-4180-b84a-e34c6cd86dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:55.927216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56111d-8604-4180-b84a-e34c6cd86dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:55.928270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56111d-8604-4180-b84a-e34c6cd86dbf service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:55.939707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1079/2161] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:57.883163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3a76c-3825-418f-bd0b-840a56d8cf48 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:57.960552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3a76c-3825-418f-bd0b-840a56d8cf48 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:57.967842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:57.968529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:57.968807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:57.969080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] PATH_INFO: `/v3/users/f4d96024207447ab8094dbd6fca71922` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:57.970944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d96024207447ab8094dbd6fca71922)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:57.972856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:58.031796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d96024207447ab8094dbd6fca71922'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.032848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d96024207447ab8094dbd6fca71922'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.047561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d96024207447ab8094dbd6fca71922'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.056744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d96024207447ab8094dbd6fca71922'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.057665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d96024207447ab8094dbd6fca71922'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.072557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1083/2162] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:57 2022] DELETE /identity/v3/users/f4d96024207447ab8094dbd6fca71922 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:58.077402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2de39a-0ad0-4f8d-b8a4-3a7e80f9c9b3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:58.077932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2de39a-0ad0-4f8d-b8a4-3a7e80f9c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:58.078023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2de39a-0ad0-4f8d-b8a4-3a7e80f9c9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:58.103838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-db2de39a-0ad0-4f8d-b8a4-3a7e80f9c9b3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:58.105789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-db2de39a-0ad0-4f8d-b8a4-3a7e80f9c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:58.225137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1080/2163] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:58.238021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:58.240412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:58.261354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:58.322181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213e4aa-c505-4fa1-aecb-4698cd6f77e9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:58.326074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17699982-1272-4eb6-a483-39dc59d22cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:58.326712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17699982-1272-4eb6-a483-39dc59d22cec service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:58.327163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17699982-1272-4eb6-a483-39dc59d22cec service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:58.327439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17699982-1272-4eb6-a483-39dc59d22cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:58.337748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17699982-1272-4eb6-a483-39dc59d22cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:58.339286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17699982-1272-4eb6-a483-39dc59d22cec service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:58.350126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1084/2164] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:41:58.750539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2de39a-0ad0-4f8d-b8a4-3a7e80f9c9b3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:58.752033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-db2de39a-0ad0-4f8d-b8a4-3a7e80f9c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:58.767863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2de39a-0ad0-4f8d-b8a4-3a7e80f9c9b3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:58.773441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:58.774439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:58.774724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:58.775019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] PATH_INFO: `/v3/projects/76920c8107d94e429c578752addb3f86` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:58.777540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76920c8107d94e429c578752addb3f86)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:58.779509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:58.836751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76920c8107d94e429c578752addb3f86', 'request_id': 'req-3e26e846-cf4a-41b0-9fcf-41433ab896d5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.842521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76920c8107d94e429c578752addb3f86', 'request_id': 'req-3e26e846-cf4a-41b0-9fcf-41433ab896d5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.852098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76920c8107d94e429c578752addb3f86', 'request_id': 'req-3e26e846-cf4a-41b0-9fcf-41433ab896d5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.865843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] The token cache is being invalidate because project 76920c8107d94e429c578752addb3f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:58.866137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.866792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:58.868453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1081/2165] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:58 2022] DELETE /identity/v3/projects/76920c8107d94e429c578752addb3f86 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:58.872618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17699982-1272-4eb6-a483-39dc59d22cec service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:58.885570 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17699982-1272-4eb6-a483-39dc59d22cec service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:58.952305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:58.952841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:58.953121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:58.953393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] PATH_INFO: `/v3/users/651c52e363b847cda5c6de7a1f9f23e6` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:58.954573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651c52e363b847cda5c6de7a1f9f23e6)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:58.957153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:59.010878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651c52e363b847cda5c6de7a1f9f23e6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.011565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651c52e363b847cda5c6de7a1f9f23e6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.029157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651c52e363b847cda5c6de7a1f9f23e6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.040414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651c52e363b847cda5c6de7a1f9f23e6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.041103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-83740d85-08c3-47ff-a9c7-7dfe9bff9da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651c52e363b847cda5c6de7a1f9f23e6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.058500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1085/2166] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:41:58 2022] DELETE /identity/v3/users/651c52e363b847cda5c6de7a1f9f23e6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:59.448768 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:59.450856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:59.478085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e846-cf4a-41b0-9fcf-41433ab896d5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:59.557375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:59.590770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:59.591649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:59.592075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:59.592763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] PATH_INFO: `/v3/projects/ae5cc0aba9ca43df870021d9a78420ef` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:59.594016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5cc0aba9ca43df870021d9a78420ef)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:59.596139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:59.666262 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5cc0aba9ca43df870021d9a78420ef', 'request_id': 'req-1816cf1b-7edc-4132-b620-0aa4727209b7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.673784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5cc0aba9ca43df870021d9a78420ef', 'request_id': 'req-1816cf1b-7edc-4132-b620-0aa4727209b7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.690824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5cc0aba9ca43df870021d9a78420ef', 'request_id': 'req-1816cf1b-7edc-4132-b620-0aa4727209b7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.707982 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] The token cache is being invalidate because project ae5cc0aba9ca43df870021d9a78420ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:41:59.708206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.708914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1816cf1b-7edc-4132-b620-0aa4727209b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:41:59.711226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1082/2167] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:41:59 2022] DELETE /identity/v3/projects/ae5cc0aba9ca43df870021d9a78420ef => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:41:59.716975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c274-3fca-44f9-8eda-d36c3279fabc None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:59.717196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c274-3fca-44f9-8eda-d36c3279fabc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:59.717560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8c274-3fca-44f9-8eda-d36c3279fabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:59.746363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a8c8c274-3fca-44f9-8eda-d36c3279fabc None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:59.747742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a8c8c274-3fca-44f9-8eda-d36c3279fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:59.792458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:41:59.837387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1086/2168] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:41:59.846222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab4c57-7740-4251-97b4-9aa7230225ab None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:59.846536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab4c57-7740-4251-97b4-9aa7230225ab None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:59.846813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab4c57-7740-4251-97b4-9aa7230225ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:59.871121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8aab4c57-7740-4251-97b4-9aa7230225ab None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:41:59.872370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8aab4c57-7740-4251-97b4-9aa7230225ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:41:59.884314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1083/2169] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:41:59.885675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8c274-3fca-44f9-8eda-d36c3279fabc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:59.896676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8c274-3fca-44f9-8eda-d36c3279fabc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:59.908524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a889b-1691-40a0-b528-8c229238055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:59.908524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a889b-1691-40a0-b528-8c229238055f admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:59.908524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a889b-1691-40a0-b528-8c229238055f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:59.909588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a889b-1691-40a0-b528-8c229238055f admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:59.909588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a889b-1691-40a0-b528-8c229238055f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:41:59.909817 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a889b-1691-40a0-b528-8c229238055f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:59.911484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a889b-1691-40a0-b528-8c229238055f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:59.925501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1087/2170] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:41:59.929985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab4c57-7740-4251-97b4-9aa7230225ab None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:41:59.943182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab4c57-7740-4251-97b4-9aa7230225ab None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:41:59.948854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2119107-d832-4669-ada0-67023e354192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:41:59.949489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2119107-d832-4669-ada0-67023e354192 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:41:59.949773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2119107-d832-4669-ada0-67023e354192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:41:59.950145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2119107-d832-4669-ada0-67023e354192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:41:59.950818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2119107-d832-4669-ada0-67023e354192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:41:59.952872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2119107-d832-4669-ada0-67023e354192 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:41:59.983258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1084/2171] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:41:59 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:41:59.988291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a889b-1691-40a0-b528-8c229238055f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.002098 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a889b-1691-40a0-b528-8c229238055f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.071086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9014f0-47db-4977-a855-700dd3063d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.071734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9014f0-47db-4977-a855-700dd3063d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.072011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9014f0-47db-4977-a855-700dd3063d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.072289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9014f0-47db-4977-a855-700dd3063d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.073018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9014f0-47db-4977-a855-700dd3063d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.075008 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9014f0-47db-4977-a855-700dd3063d4a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.098653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1088/2172] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:41:59 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:00.102792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2119107-d832-4669-ada0-67023e354192 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.115794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2119107-d832-4669-ada0-67023e354192 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.120558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d24386-1d00-41d7-8fad-5cb3dda8d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.121181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d24386-1d00-41d7-8fad-5cb3dda8d45f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.121494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d24386-1d00-41d7-8fad-5cb3dda8d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.121839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d24386-1d00-41d7-8fad-5cb3dda8d45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.122613 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d24386-1d00-41d7-8fad-5cb3dda8d45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.124421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d24386-1d00-41d7-8fad-5cb3dda8d45f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.136292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1085/2173] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:00.141087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9014f0-47db-4977-a855-700dd3063d4a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.151425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9014f0-47db-4977-a855-700dd3063d4a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.156445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d616fb7-4250-46c1-9017-16d7c8214f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.157028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616fb7-4250-46c1-9017-16d7c8214f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.157354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616fb7-4250-46c1-9017-16d7c8214f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.157582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d616fb7-4250-46c1-9017-16d7c8214f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.158291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d616fb7-4250-46c1-9017-16d7c8214f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.160496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d616fb7-4250-46c1-9017-16d7c8214f8d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.172291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1089/2174] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:00.177813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d24386-1d00-41d7-8fad-5cb3dda8d45f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.189671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d24386-1d00-41d7-8fad-5cb3dda8d45f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.194822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306708-58c3-492c-aac5-ab31eb492b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.195573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306708-58c3-492c-aac5-ab31eb492b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.195854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306708-58c3-492c-aac5-ab31eb492b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.196132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306708-58c3-492c-aac5-ab31eb492b92 admin admin] PATH_INFO: `/v3/projects/b02aee37ba7f47e2935a5052b081e2eb/users/dc617a9fabba4a3c828be4cf5e450e01/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.212040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11306708-58c3-492c-aac5-ab31eb492b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02aee37ba7f47e2935a5052b081e2eb, user_id=dc617a9fabba4a3c828be4cf5e450e01, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.214800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11306708-58c3-492c-aac5-ab31eb492b92 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.229734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1086/2175] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:00 2022] PUT /identity/v3/projects/b02aee37ba7f47e2935a5052b081e2eb/users/dc617a9fabba4a3c828be4cf5e450e01/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:00.242276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d12a43-19e0-44de-b179-6622aff6ffd7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.242591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d12a43-19e0-44de-b179-6622aff6ffd7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.242870 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d12a43-19e0-44de-b179-6622aff6ffd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.276191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-50d12a43-19e0-44de-b179-6622aff6ffd7 None None] MFA Rules not processed for user `dc617a9fabba4a3c828be4cf5e450e01`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:00.277419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-50d12a43-19e0-44de-b179-6622aff6ffd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:00.355741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1090/2176] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:00.361730 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306708-58c3-492c-aac5-ab31eb492b92 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.430170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306708-58c3-492c-aac5-ab31eb492b92 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.435142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa590c-b8d2-4728-a1ef-131fc4e0ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.435798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa590c-b8d2-4728-a1ef-131fc4e0ca55 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.436078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa590c-b8d2-4728-a1ef-131fc4e0ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.436347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa590c-b8d2-4728-a1ef-131fc4e0ca55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.437011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa590c-b8d2-4728-a1ef-131fc4e0ca55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.438936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa590c-b8d2-4728-a1ef-131fc4e0ca55 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.450569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:00.470090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1087/2177] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:00 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:00.474890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d12a43-19e0-44de-b179-6622aff6ffd7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.485963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d12a43-19e0-44de-b179-6622aff6ffd7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.516460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:00.550483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5df494-92a5-4b21-a4bc-2c6af6f8f181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.551141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5df494-92a5-4b21-a4bc-2c6af6f8f181 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.551445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5df494-92a5-4b21-a4bc-2c6af6f8f181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.551718 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5df494-92a5-4b21-a4bc-2c6af6f8f181 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.552375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5df494-92a5-4b21-a4bc-2c6af6f8f181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.554282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5df494-92a5-4b21-a4bc-2c6af6f8f181 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.575685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1091/2178] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:00 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:00.579693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa590c-b8d2-4728-a1ef-131fc4e0ca55 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.590877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa590c-b8d2-4728-a1ef-131fc4e0ca55 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.595845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fef7c1-e41d-4db7-a149-86b3b4b658e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.597031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fef7c1-e41d-4db7-a149-86b3b4b658e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.597316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fef7c1-e41d-4db7-a149-86b3b4b658e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.597621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fef7c1-e41d-4db7-a149-86b3b4b658e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.598419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fef7c1-e41d-4db7-a149-86b3b4b658e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.600111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fef7c1-e41d-4db7-a149-86b3b4b658e1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.611591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1088/2179] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:00.615881 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5df494-92a5-4b21-a4bc-2c6af6f8f181 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.628623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5df494-92a5-4b21-a4bc-2c6af6f8f181 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.634056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d151e-819c-4417-82d2-b1fbf6ece093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.634764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d151e-819c-4417-82d2-b1fbf6ece093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.635053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d151e-819c-4417-82d2-b1fbf6ece093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.635367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d151e-819c-4417-82d2-b1fbf6ece093 admin admin] PATH_INFO: `/v3/projects/958c58137761461aa38eb3488816bae1/users/fbc54566b9d44261bcb980978a14bfc7/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.653326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d151e-819c-4417-82d2-b1fbf6ece093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958c58137761461aa38eb3488816bae1, user_id=fbc54566b9d44261bcb980978a14bfc7, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.658061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d151e-819c-4417-82d2-b1fbf6ece093 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.675252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1092/2180] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:00 2022] PUT /identity/v3/projects/958c58137761461aa38eb3488816bae1/users/fbc54566b9d44261bcb980978a14bfc7/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:00.682855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fef7c1-e41d-4db7-a149-86b3b4b658e1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.701905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fef7c1-e41d-4db7-a149-86b3b4b658e1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.804427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c6714-cdeb-40a9-90fe-0e41200f1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.805520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6714-cdeb-40a9-90fe-0e41200f1a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.805812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6714-cdeb-40a9-90fe-0e41200f1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.806118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c6714-cdeb-40a9-90fe-0e41200f1a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.806904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c6714-cdeb-40a9-90fe-0e41200f1a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.808788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c6714-cdeb-40a9-90fe-0e41200f1a67 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.825344 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1089/2181] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:00.829204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d151e-819c-4417-82d2-b1fbf6ece093 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:00.839484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d151e-819c-4417-82d2-b1fbf6ece093 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:00.847661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7f214-9f2e-4d5c-8956-9b1dea823fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:00.848349 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7f214-9f2e-4d5c-8956-9b1dea823fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.848770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7f214-9f2e-4d5c-8956-9b1dea823fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.849050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7f214-9f2e-4d5c-8956-9b1dea823fcc admin admin] PATH_INFO: `/v3/projects/958c58137761461aa38eb3488816bae1/users/fbc54566b9d44261bcb980978a14bfc7/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.851103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7f214-9f2e-4d5c-8956-9b1dea823fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=958c58137761461aa38eb3488816bae1, user_id=fbc54566b9d44261bcb980978a14bfc7, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:00.853998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7f214-9f2e-4d5c-8956-9b1dea823fcc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:00.868157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1093/2182] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:00 2022] PUT /identity/v3/projects/958c58137761461aa38eb3488816bae1/users/fbc54566b9d44261bcb980978a14bfc7/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:00.881004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79ebdf-c6d6-4071-aaa9-fffc342e297a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:00.881463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79ebdf-c6d6-4071-aaa9-fffc342e297a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:00.881854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79ebdf-c6d6-4071-aaa9-fffc342e297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:00.932214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3d79ebdf-c6d6-4071-aaa9-fffc342e297a None None] MFA Rules not processed for user `fbc54566b9d44261bcb980978a14bfc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:00.933586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3d79ebdf-c6d6-4071-aaa9-fffc342e297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:01.075650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1090/2183] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:01.084842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7f214-9f2e-4d5c-8956-9b1dea823fcc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:01.087746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f1c7f214-9f2e-4d5c-8956-9b1dea823fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:01.165811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7f214-9f2e-4d5c-8956-9b1dea823fcc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:01.170617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df8694-c4dd-4755-9fec-1e4fceb6a5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:01.170908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df8694-c4dd-4755-9fec-1e4fceb6a5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:01.171330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df8694-c4dd-4755-9fec-1e4fceb6a5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:01.171708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df8694-c4dd-4755-9fec-1e4fceb6a5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:01.243148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df8694-c4dd-4755-9fec-1e4fceb6a5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:01.244638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df8694-c4dd-4755-9fec-1e4fceb6a5d7 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:01.254776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1094/2184] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:03.960028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79ebdf-c6d6-4071-aaa9-fffc342e297a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:03.971355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79ebdf-c6d6-4071-aaa9-fffc342e297a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:03.975676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fb9b4-3126-4fdc-b364-5ac5c0f8feae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:03.976307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb9b4-3126-4fdc-b364-5ac5c0f8feae service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:03.976590 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb9b4-3126-4fdc-b364-5ac5c0f8feae service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:03.976870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb9b4-3126-4fdc-b364-5ac5c0f8feae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:03.987598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fb9b4-3126-4fdc-b364-5ac5c0f8feae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:03.989121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fb9b4-3126-4fdc-b364-5ac5c0f8feae service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:03.999988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1091/2185] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:05.894909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd451d6f-9b3b-4551-891e-7c2aec29ef45 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:05.895482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd451d6f-9b3b-4551-891e-7c2aec29ef45 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:05.895655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd451d6f-9b3b-4551-891e-7c2aec29ef45 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:05.897200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1095/2186] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:42:05.924680 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d83cd-0e34-458b-a373-231bbd9ebc27 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:05.925246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d83cd-0e34-458b-a373-231bbd9ebc27 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:05.925334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d83cd-0e34-458b-a373-231bbd9ebc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:05.946105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9b2d83cd-0e34-458b-a373-231bbd9ebc27 None None] MFA Rules not processed for user `a5c20a5a655b43d1899bf2319647a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:05.948443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9b2d83cd-0e34-458b-a373-231bbd9ebc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:06.046954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:06.082464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1092/2187] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:42:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:06.101574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd451d6f-9b3b-4551-891e-7c2aec29ef45 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:06.103445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fd451d6f-9b3b-4551-891e-7c2aec29ef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:06.125326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd451d6f-9b3b-4551-891e-7c2aec29ef45 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:06.131642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df300c6-648b-463a-9b3d-84ebd7b44f08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:06.132541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df300c6-648b-463a-9b3d-84ebd7b44f08 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:06.132886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df300c6-648b-463a-9b3d-84ebd7b44f08 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:06.133459 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df300c6-648b-463a-9b3d-84ebd7b44f08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:06.146453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df300c6-648b-463a-9b3d-84ebd7b44f08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:06.148231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df300c6-648b-463a-9b3d-84ebd7b44f08 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:06.162113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1096/2188] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:06.570576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d83cd-0e34-458b-a373-231bbd9ebc27 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:06.572068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9b2d83cd-0e34-458b-a373-231bbd9ebc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:06.662822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d83cd-0e34-458b-a373-231bbd9ebc27 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:06.668770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:06.669424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:06.669721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:06.670059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] PATH_INFO: `/v3/users/1082a31368be4f61b329a5f6f435b564` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:06.671529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1082a31368be4f61b329a5f6f435b564)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:06.673737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:06.748240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1082a31368be4f61b329a5f6f435b564'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:06.748984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1082a31368be4f61b329a5f6f435b564'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:06.772273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1082a31368be4f61b329a5f6f435b564'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:06.789927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1082a31368be4f61b329a5f6f435b564'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:06.807630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1082a31368be4f61b329a5f6f435b564'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:06.821446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1093/2189] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:06 2022] DELETE /identity/v3/users/1082a31368be4f61b329a5f6f435b564 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:07.163365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df300c6-648b-463a-9b3d-84ebd7b44f08 service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:07.175637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df300c6-648b-463a-9b3d-84ebd7b44f08 service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:07.197299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:07.244578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:07.245246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:07.245528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:07.245802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] PATH_INFO: `/v3/projects/d628856b25964ad0a04fa18e63310d8e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:07.247049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d628856b25964ad0a04fa18e63310d8e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:07.249478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:07.298743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd628856b25964ad0a04fa18e63310d8e', 'request_id': 'req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.304850 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd628856b25964ad0a04fa18e63310d8e', 'request_id': 'req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.313128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd628856b25964ad0a04fa18e63310d8e', 'request_id': 'req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.325984 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] The token cache is being invalidate because project d628856b25964ad0a04fa18e63310d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:07.326272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.326944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.328553 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1097/2190] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:07 2022] DELETE /identity/v3/projects/d628856b25964ad0a04fa18e63310d8e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:07.332907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:07.334449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:07.348454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423e984-4433-41ed-8aba-2fc0240b4c48 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:07.416604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:07.417362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:07.417708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:07.418027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] PATH_INFO: `/v3/users/c8d51abc5ed741bab312fe7e68d1bcd6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:07.419710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d51abc5ed741bab312fe7e68d1bcd6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:07.422906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:07.430002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:07.481444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d51abc5ed741bab312fe7e68d1bcd6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.482155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d51abc5ed741bab312fe7e68d1bcd6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.498005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d51abc5ed741bab312fe7e68d1bcd6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.507056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d51abc5ed741bab312fe7e68d1bcd6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.517814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ddf11ad1-0f55-474b-ac27-e4ab405fc71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d51abc5ed741bab312fe7e68d1bcd6'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.525366 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1094/2191] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:07 2022] DELETE /identity/v3/users/c8d51abc5ed741bab312fe7e68d1bcd6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:07.723959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:07.725421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:07.745489 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb4cae-6dd2-41b1-a79b-13e35b00623e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:07.822557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:07.823251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:07.823531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:07.823810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] PATH_INFO: `/v3/projects/4941ad3486f841e2a95508469766cd5f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:07.824981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4941ad3486f841e2a95508469766cd5f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:07.826934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:07.876215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4941ad3486f841e2a95508469766cd5f', 'request_id': 'req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.880412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:07.882783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4941ad3486f841e2a95508469766cd5f', 'request_id': 'req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.891526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4941ad3486f841e2a95508469766cd5f', 'request_id': 'req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.903317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] The token cache is being invalidate because project 4941ad3486f841e2a95508469766cd5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:07.903601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.904234 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-12d890f4-79d8-4700-be3c-7b7cd3c8ad2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:07.905761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1098/2192] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:07 2022] DELETE /identity/v3/projects/4941ad3486f841e2a95508469766cd5f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:07.911561 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bcc1-3619-46c6-a6fb-b5f9d519f806 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:07.911849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bcc1-3619-46c6-a6fb-b5f9d519f806 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:07.912113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563bcc1-3619-46c6-a6fb-b5f9d519f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:07.933096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b563bcc1-3619-46c6-a6fb-b5f9d519f806 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:07.934301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b563bcc1-3619-46c6-a6fb-b5f9d519f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:08.008170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1095/2193] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:08.017432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5871a-fddb-4306-8f49-68b73add393b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:08.018391 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5871a-fddb-4306-8f49-68b73add393b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:08.018774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5871a-fddb-4306-8f49-68b73add393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:08.040937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8df5871a-fddb-4306-8f49-68b73add393b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:08.042154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8df5871a-fddb-4306-8f49-68b73add393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:08.051805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1099/2194] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:08.055183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563bcc1-3619-46c6-a6fb-b5f9d519f806 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:08.064936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563bcc1-3619-46c6-a6fb-b5f9d519f806 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:08.069467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff62f8-1b34-44b8-934c-42ba7ce29219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:08.070115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff62f8-1b34-44b8-934c-42ba7ce29219 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:08.070381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff62f8-1b34-44b8-934c-42ba7ce29219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:08.070649 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff62f8-1b34-44b8-934c-42ba7ce29219 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:08.071469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff62f8-1b34-44b8-934c-42ba7ce29219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:42:08.071770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff62f8-1b34-44b8-934c-42ba7ce29219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:08.073371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff62f8-1b34-44b8-934c-42ba7ce29219 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:08.089791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1096/2195] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:42:08.091029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5871a-fddb-4306-8f49-68b73add393b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:08.106281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5871a-fddb-4306-8f49-68b73add393b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:08.112439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e270a9-f955-402b-9644-583bdbae343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:08.113511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e270a9-f955-402b-9644-583bdbae343e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:08.113943 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e270a9-f955-402b-9644-583bdbae343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:08.114385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e270a9-f955-402b-9644-583bdbae343e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:08.115101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e270a9-f955-402b-9644-583bdbae343e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:08.117101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e270a9-f955-402b-9644-583bdbae343e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:08.155531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1100/2196] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:08 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:08.161662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff62f8-1b34-44b8-934c-42ba7ce29219 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:08.180270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff62f8-1b34-44b8-934c-42ba7ce29219 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:08.270243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0451c0-86e2-44e5-b09d-8a89b5cd2fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:08.271110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0451c0-86e2-44e5-b09d-8a89b5cd2fad admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:08.271506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0451c0-86e2-44e5-b09d-8a89b5cd2fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:08.271871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0451c0-86e2-44e5-b09d-8a89b5cd2fad admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:08.272641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0451c0-86e2-44e5-b09d-8a89b5cd2fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:08.274683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0451c0-86e2-44e5-b09d-8a89b5cd2fad admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:08.299857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:08.306725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1097/2197] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:08 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:08.312824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e270a9-f955-402b-9644-583bdbae343e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:08.324464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e270a9-f955-402b-9644-583bdbae343e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:08.329418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff1932-3d0f-4116-9082-9e467bd7d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:08.330042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff1932-3d0f-4116-9082-9e467bd7d4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:08.330388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff1932-3d0f-4116-9082-9e467bd7d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:08.331304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff1932-3d0f-4116-9082-9e467bd7d4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:08.332013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff1932-3d0f-4116-9082-9e467bd7d4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:08.333607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff1932-3d0f-4116-9082-9e467bd7d4d9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:08.357244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1101/2198] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:08.364899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0451c0-86e2-44e5-b09d-8a89b5cd2fad admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:08.375920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0451c0-86e2-44e5-b09d-8a89b5cd2fad admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:08.381988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aacbc-b6fe-491e-9ac9-ae7df3a8fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:08.382914 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aacbc-b6fe-491e-9ac9-ae7df3a8fb40 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:08.386666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aacbc-b6fe-491e-9ac9-ae7df3a8fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:08.386666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aacbc-b6fe-491e-9ac9-ae7df3a8fb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:08.386666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aacbc-b6fe-491e-9ac9-ae7df3a8fb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:08.386666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aacbc-b6fe-491e-9ac9-ae7df3a8fb40 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:08.399650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1098/2199] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:08.403897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff1932-3d0f-4116-9082-9e467bd7d4d9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:08.414834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff1932-3d0f-4116-9082-9e467bd7d4d9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:08.419480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362c1b3-69e1-46e3-8cc1-9ad7e13a4c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:08.420149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362c1b3-69e1-46e3-8cc1-9ad7e13a4c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:08.420432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362c1b3-69e1-46e3-8cc1-9ad7e13a4c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:08.420712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362c1b3-69e1-46e3-8cc1-9ad7e13a4c9a admin admin] PATH_INFO: `/v3/projects/747f905d471d4f68a82f2c21621b3162/users/71497acb7d0a4a34a36ee0baa8a5e024/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:08.437324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362c1b3-69e1-46e3-8cc1-9ad7e13a4c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=747f905d471d4f68a82f2c21621b3162, user_id=71497acb7d0a4a34a36ee0baa8a5e024, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:08.440622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362c1b3-69e1-46e3-8cc1-9ad7e13a4c9a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:08.456852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1102/2200] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:08 2022] PUT /identity/v3/projects/747f905d471d4f68a82f2c21621b3162/users/71497acb7d0a4a34a36ee0baa8a5e024/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:42:08.467757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f3cd7-4ac9-43fe-ace9-f6982b6e66a0 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:08.468044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f3cd7-4ac9-43fe-ace9-f6982b6e66a0 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:08.468433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f3cd7-4ac9-43fe-ace9-f6982b6e66a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:08.500440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4b9f3cd7-4ac9-43fe-ace9-f6982b6e66a0 None None] MFA Rules not processed for user `71497acb7d0a4a34a36ee0baa8a5e024`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:08.501622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4b9f3cd7-4ac9-43fe-ace9-f6982b6e66a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:08.574074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1099/2201] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:08.585554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362c1b3-69e1-46e3-8cc1-9ad7e13a4c9a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:08.587304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9362c1b3-69e1-46e3-8cc1-9ad7e13a4c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:08.656499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362c1b3-69e1-46e3-8cc1-9ad7e13a4c9a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:08.660305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebbc9-967f-4a32-8919-303219f73a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:08.660931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebbc9-967f-4a32-8919-303219f73a71 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:08.661314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebbc9-967f-4a32-8919-303219f73a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:08.661606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebbc9-967f-4a32-8919-303219f73a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:08.671341 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ebbc9-967f-4a32-8919-303219f73a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:08.672798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ebbc9-967f-4a32-8919-303219f73a71 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:08.683456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1103/2202] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:14.332571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f3cd7-4ac9-43fe-ace9-f6982b6e66a0 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:14.400979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f3cd7-4ac9-43fe-ace9-f6982b6e66a0 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:14.405753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:14.406435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:14.406713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:14.407006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] PATH_INFO: `/v3/users/71497acb7d0a4a34a36ee0baa8a5e024` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:14.408869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71497acb7d0a4a34a36ee0baa8a5e024)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:14.410941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:14.468221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71497acb7d0a4a34a36ee0baa8a5e024'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:14.468892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71497acb7d0a4a34a36ee0baa8a5e024'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:14.481454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71497acb7d0a4a34a36ee0baa8a5e024'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:14.492299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71497acb7d0a4a34a36ee0baa8a5e024'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:14.501827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71497acb7d0a4a34a36ee0baa8a5e024'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:14.504001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:14.511517 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1100/2203] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:14 2022] DELETE /identity/v3/users/71497acb7d0a4a34a36ee0baa8a5e024 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:14.516456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3d29-e783-47cc-85c7-613262cf6a48 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:14.517038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3d29-e783-47cc-85c7-613262cf6a48 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:14.517141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3d29-e783-47cc-85c7-613262cf6a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:14.545938 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5c1f3d29-e783-47cc-85c7-613262cf6a48 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:14.559311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5c1f3d29-e783-47cc-85c7-613262cf6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:14.693779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1104/2204] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:14.710146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:14.711810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:14.864671 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351ebe-5b3d-49fa-b5fa-48938d5cedb0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:14.871753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ca68f-9f0e-4627-9f08-7b65504ac50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:14.873061 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ca68f-9f0e-4627-9f08-7b65504ac50e service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:14.873523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ca68f-9f0e-4627-9f08-7b65504ac50e service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:14.873947 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ca68f-9f0e-4627-9f08-7b65504ac50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:14.895810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ca68f-9f0e-4627-9f08-7b65504ac50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:14.897268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ca68f-9f0e-4627-9f08-7b65504ac50e service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:14.919382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1101/2205] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:15.020800 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18e68c-75ff-4ffb-9e20-89ebc235a291 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:15.021064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18e68c-75ff-4ffb-9e20-89ebc235a291 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:15.021417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18e68c-75ff-4ffb-9e20-89ebc235a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:15.044400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2e18e68c-75ff-4ffb-9e20-89ebc235a291 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:15.046435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2e18e68c-75ff-4ffb-9e20-89ebc235a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:15.068853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:15.137721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1105/2206] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:42:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:15.203441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ca68f-9f0e-4627-9f08-7b65504ac50e service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:15.205509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-437ca68f-9f0e-4627-9f08-7b65504ac50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:15.310513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18e68c-75ff-4ffb-9e20-89ebc235a291 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:15.315155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2e18e68c-75ff-4ffb-9e20-89ebc235a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:15.332193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18e68c-75ff-4ffb-9e20-89ebc235a291 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:15.344441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:15.345108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:15.345390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:15.345855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] PATH_INFO: `/v3/projects/747f905d471d4f68a82f2c21621b3162` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:15.347788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] RBAC: Authorizing `identity:delete_project(project_id=747f905d471d4f68a82f2c21621b3162)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:15.349581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:15.387195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ca68f-9f0e-4627-9f08-7b65504ac50e service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:15.400838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363ed01-76a9-4b70-919d-c95329843c6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:15.404491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363ed01-76a9-4b70-919d-c95329843c6c service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:15.404491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363ed01-76a9-4b70-919d-c95329843c6c service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:15.404491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363ed01-76a9-4b70-919d-c95329843c6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:15.423285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363ed01-76a9-4b70-919d-c95329843c6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:15.425441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747f905d471d4f68a82f2c21621b3162', 'request_id': 'req-dd64be64-a311-43d7-b0e9-d35cee1a207a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:15.427432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363ed01-76a9-4b70-919d-c95329843c6c service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:15.438613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747f905d471d4f68a82f2c21621b3162', 'request_id': 'req-dd64be64-a311-43d7-b0e9-d35cee1a207a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:15.441005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1102/2207] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:42:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:15.474015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747f905d471d4f68a82f2c21621b3162', 'request_id': 'req-dd64be64-a311-43d7-b0e9-d35cee1a207a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:15.517839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] The token cache is being invalidate because project 747f905d471d4f68a82f2c21621b3162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:15.518449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:15.518833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-dd64be64-a311-43d7-b0e9-d35cee1a207a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:15.520650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1106/2208] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:15 2022] DELETE /identity/v3/projects/747f905d471d4f68a82f2c21621b3162 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:15.525583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3fb9-d1f2-407c-b318-7924bb3491d8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:15.526028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3fb9-d1f2-407c-b318-7924bb3491d8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:15.526308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3fb9-d1f2-407c-b318-7924bb3491d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:15.558203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7ffb3fb9-d1f2-407c-b318-7924bb3491d8 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:15.559530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7ffb3fb9-d1f2-407c-b318-7924bb3491d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:15.655333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1103/2209] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:15.657676 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054c0f7-e5a5-48c8-8d77-11b177d5a422 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:15.658209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054c0f7-e5a5-48c8-8d77-11b177d5a422 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:15.658558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054c0f7-e5a5-48c8-8d77-11b177d5a422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:15.693434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3054c0f7-e5a5-48c8-8d77-11b177d5a422 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:15.696474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3054c0f7-e5a5-48c8-8d77-11b177d5a422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:15.709894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1107/2210] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:15.710507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3fb9-d1f2-407c-b318-7924bb3491d8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:15.726007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3fb9-d1f2-407c-b318-7924bb3491d8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:15.740938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476e711-2b7d-40f7-bbbd-996141163d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:15.741672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476e711-2b7d-40f7-bbbd-996141163d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:15.743391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476e711-2b7d-40f7-bbbd-996141163d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:15.743690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476e711-2b7d-40f7-bbbd-996141163d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:15.744937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476e711-2b7d-40f7-bbbd-996141163d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:42:15.745260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476e711-2b7d-40f7-bbbd-996141163d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:15.747244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476e711-2b7d-40f7-bbbd-996141163d6a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:15.769966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1104/2211] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:42:15.780248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054c0f7-e5a5-48c8-8d77-11b177d5a422 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:15.795773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054c0f7-e5a5-48c8-8d77-11b177d5a422 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:15.801510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ac82c-905a-4417-a57a-49ad893abe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:15.802356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ac82c-905a-4417-a57a-49ad893abe5e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:15.802635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ac82c-905a-4417-a57a-49ad893abe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:15.802908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ac82c-905a-4417-a57a-49ad893abe5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:15.803616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ac82c-905a-4417-a57a-49ad893abe5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:15.805555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ac82c-905a-4417-a57a-49ad893abe5e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:15.885584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1108/2212] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:15 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:15.888608 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476e711-2b7d-40f7-bbbd-996141163d6a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:15.902124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476e711-2b7d-40f7-bbbd-996141163d6a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:15.925174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:16.013956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb09b1-22a6-4e0c-9173-3e4d676fc9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:16.014585 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb09b1-22a6-4e0c-9173-3e4d676fc9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.014865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb09b1-22a6-4e0c-9173-3e4d676fc9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.015380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb09b1-22a6-4e0c-9173-3e4d676fc9cd admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.016055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb09b1-22a6-4e0c-9173-3e4d676fc9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:16.019073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb09b1-22a6-4e0c-9173-3e4d676fc9cd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:16.065173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1105/2213] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:15 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:16.070003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ac82c-905a-4417-a57a-49ad893abe5e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:16.096468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ac82c-905a-4417-a57a-49ad893abe5e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:16.101842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a166-9ba9-4f7b-a840-d0b675a44eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:16.102574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a166-9ba9-4f7b-a840-d0b675a44eac admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.102927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a166-9ba9-4f7b-a840-d0b675a44eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.103652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a166-9ba9-4f7b-a840-d0b675a44eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.105730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55a166-9ba9-4f7b-a840-d0b675a44eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:16.107771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55a166-9ba9-4f7b-a840-d0b675a44eac admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:16.121825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1109/2214] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:16.126219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb09b1-22a6-4e0c-9173-3e4d676fc9cd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:16.138607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb09b1-22a6-4e0c-9173-3e4d676fc9cd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:16.145221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52372d1d-4ce8-4c04-8206-d626672a07d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:16.145656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52372d1d-4ce8-4c04-8206-d626672a07d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.145961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52372d1d-4ce8-4c04-8206-d626672a07d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.146253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52372d1d-4ce8-4c04-8206-d626672a07d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.146892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52372d1d-4ce8-4c04-8206-d626672a07d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:16.148629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52372d1d-4ce8-4c04-8206-d626672a07d6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:16.164473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1106/2215] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:16.169062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a166-9ba9-4f7b-a840-d0b675a44eac admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:16.202199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a166-9ba9-4f7b-a840-d0b675a44eac admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:16.209283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534c574-8f56-4998-8a6a-3116ecc2788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:16.209981 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534c574-8f56-4998-8a6a-3116ecc2788a admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.210326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534c574-8f56-4998-8a6a-3116ecc2788a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.210610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534c574-8f56-4998-8a6a-3116ecc2788a admin admin] PATH_INFO: `/v3/projects/8bcee9d830ce421c9594f8f436c2494d/users/e529c49ecd9941f4b95655de1d702fe5/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.238430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534c574-8f56-4998-8a6a-3116ecc2788a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcee9d830ce421c9594f8f436c2494d, user_id=e529c49ecd9941f4b95655de1d702fe5, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:16.242733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534c574-8f56-4998-8a6a-3116ecc2788a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:16.277340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1110/2216] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:16 2022] PUT /identity/v3/projects/8bcee9d830ce421c9594f8f436c2494d/users/e529c49ecd9941f4b95655de1d702fe5/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:16.280658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c40c3-e31e-4bc7-b5ee-d23cabade1a7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.280949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c40c3-e31e-4bc7-b5ee-d23cabade1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.281229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c40c3-e31e-4bc7-b5ee-d23cabade1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.317078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8b6c40c3-e31e-4bc7-b5ee-d23cabade1a7 None None] MFA Rules not processed for user `e529c49ecd9941f4b95655de1d702fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:16.318305 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8b6c40c3-e31e-4bc7-b5ee-d23cabade1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:16.321835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec26098-484e-4484-9b25-7ddfba595a3c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.322135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec26098-484e-4484-9b25-7ddfba595a3c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.322385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec26098-484e-4484-9b25-7ddfba595a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.355653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1ec26098-484e-4484-9b25-7ddfba595a3c None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:16.356977 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1ec26098-484e-4484-9b25-7ddfba595a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:16.414692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1107/2217] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:16.419337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:16.427751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c40c3-e31e-4bc7-b5ee-d23cabade1a7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:16.429218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8b6c40c3-e31e-4bc7-b5ee-d23cabade1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:16.432217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1111/2218] 10.222.0.57 () {58 vars in 967 bytes} [Thu Aug 4 04:42:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:16.449163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec26098-484e-4484-9b25-7ddfba595a3c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:16.450634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1ec26098-484e-4484-9b25-7ddfba595a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:16.510652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c40c3-e31e-4bc7-b5ee-d23cabade1a7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:16.514594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a69504-e729-4fb1-9e32-dbe6e688705b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:16.515260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a69504-e729-4fb1-9e32-dbe6e688705b service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.515567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a69504-e729-4fb1-9e32-dbe6e688705b service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.515854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a69504-e729-4fb1-9e32-dbe6e688705b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.526737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a69504-e729-4fb1-9e32-dbe6e688705b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:16.528249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a69504-e729-4fb1-9e32-dbe6e688705b service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:16.531531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec26098-484e-4484-9b25-7ddfba595a3c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:16.539933 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143b486-533a-4587-841f-62f1d6394a08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:16.540533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1108/2219] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:16.541031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143b486-533a-4587-841f-62f1d6394a08 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.541462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143b486-533a-4587-841f-62f1d6394a08 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.541913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143b486-533a-4587-841f-62f1d6394a08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.551901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143b486-533a-4587-841f-62f1d6394a08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:16.553551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143b486-533a-4587-841f-62f1d6394a08 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:16.563275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1112/2220] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:42:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 04:42:16.914870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618d927-5a17-4dec-974d-18cc111c3ea8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.916762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618d927-5a17-4dec-974d-18cc111c3ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.917389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618d927-5a17-4dec-974d-18cc111c3ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.945448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0618d927-5a17-4dec-974d-18cc111c3ea8 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:16.946853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0618d927-5a17-4dec-974d-18cc111c3ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:16.954464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1109/2221] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:42:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:16.967333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143b486-533a-4587-841f-62f1d6394a08 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:16.978831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143b486-533a-4587-841f-62f1d6394a08 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:16.984586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21f912-c203-482a-8328-f6b7a46dd270 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:16.985209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f912-c203-482a-8328-f6b7a46dd270 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:16.985541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f912-c203-482a-8328-f6b7a46dd270 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:16.985816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f912-c203-482a-8328-f6b7a46dd270 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:16.997520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21f912-c203-482a-8328-f6b7a46dd270 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:17.000284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21f912-c203-482a-8328-f6b7a46dd270 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:17.014641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1113/2222] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:42:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:17.357356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b206-89a1-4cfb-9ce4-cf5ca891114f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:17.357647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b206-89a1-4cfb-9ce4-cf5ca891114f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:17.357922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b206-89a1-4cfb-9ce4-cf5ca891114f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:17.378005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-5944b206-89a1-4cfb-9ce4-cf5ca891114f None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:17.379254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5944b206-89a1-4cfb-9ce4-cf5ca891114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:17.387032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1110/2223] 10.222.0.57 () {58 vars in 967 bytes} [Thu Aug 4 04:42:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:17.400067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21f912-c203-482a-8328-f6b7a46dd270 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:17.412530 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21f912-c203-482a-8328-f6b7a46dd270 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:17.419288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254d348-7b57-4b44-abd8-2df693ec5c6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:17.420369 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d348-7b57-4b44-abd8-2df693ec5c6d service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:17.420834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d348-7b57-4b44-abd8-2df693ec5c6d service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:17.421286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d348-7b57-4b44-abd8-2df693ec5c6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:17.431757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254d348-7b57-4b44-abd8-2df693ec5c6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:17.433400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254d348-7b57-4b44-abd8-2df693ec5c6d service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:17.442957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1114/2224] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:42:17.632944 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b206-89a1-4cfb-9ce4-cf5ca891114f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:17.634729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-5944b206-89a1-4cfb-9ce4-cf5ca891114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:17.655178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:17.707583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b206-89a1-4cfb-9ce4-cf5ca891114f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:17.712128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:17.714500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:17.714500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:17.714500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] PATH_INFO: `/v3/users/dc617a9fabba4a3c828be4cf5e450e01` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:17.715635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc617a9fabba4a3c828be4cf5e450e01)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:17.717656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:17.799886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc617a9fabba4a3c828be4cf5e450e01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:17.800742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc617a9fabba4a3c828be4cf5e450e01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:17.822200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc617a9fabba4a3c828be4cf5e450e01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:17.830763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc617a9fabba4a3c828be4cf5e450e01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:17.841691 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc617a9fabba4a3c828be4cf5e450e01'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:17.850564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1111/2225] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:17 2022] DELETE /identity/v3/users/dc617a9fabba4a3c828be4cf5e450e01 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:17.855889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa253-8d56-41c1-b04b-4ae904421318 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:17.856571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa253-8d56-41c1-b04b-4ae904421318 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:17.856571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa253-8d56-41c1-b04b-4ae904421318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:17.880313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-44caa253-8d56-41c1-b04b-4ae904421318 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:17.881574 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-44caa253-8d56-41c1-b04b-4ae904421318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:17.968957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1115/2226] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:17.981223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:17.982956 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:18.078254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e2df7-9542-41a2-bf6c-7f84ec876e39 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:18.082807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf64a30-3e88-4f5c-b033-f40e7d0d862f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:18.083696 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf64a30-3e88-4f5c-b033-f40e7d0d862f service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:18.084184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf64a30-3e88-4f5c-b033-f40e7d0d862f service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:18.084644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf64a30-3e88-4f5c-b033-f40e7d0d862f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:18.095642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf64a30-3e88-4f5c-b033-f40e7d0d862f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:18.097210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf64a30-3e88-4f5c-b033-f40e7d0d862f service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:18.108120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1112/2227] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:18.461275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa253-8d56-41c1-b04b-4ae904421318 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:18.466643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-44caa253-8d56-41c1-b04b-4ae904421318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:18.484901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa253-8d56-41c1-b04b-4ae904421318 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:18.502829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:18.503911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:18.505440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:18.505440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] PATH_INFO: `/v3/projects/b02aee37ba7f47e2935a5052b081e2eb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:18.506772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02aee37ba7f47e2935a5052b081e2eb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:18.509003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:18.585908 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02aee37ba7f47e2935a5052b081e2eb', 'request_id': 'req-0d285c91-de68-48fd-92d1-ef6a18464001'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.587289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:18.593917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02aee37ba7f47e2935a5052b081e2eb', 'request_id': 'req-0d285c91-de68-48fd-92d1-ef6a18464001'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.604427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02aee37ba7f47e2935a5052b081e2eb', 'request_id': 'req-0d285c91-de68-48fd-92d1-ef6a18464001'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.635103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] The token cache is being invalidate because project b02aee37ba7f47e2935a5052b081e2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:18.635103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.638011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.639811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1116/2228] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:18 2022] DELETE /identity/v3/projects/b02aee37ba7f47e2935a5052b081e2eb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:18.643971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf64a30-3e88-4f5c-b033-f40e7d0d862f service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:18.654811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf64a30-3e88-4f5c-b033-f40e7d0d862f service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:18.708333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:18.736953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:18.737697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:18.738145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:18.738570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] PATH_INFO: `/v3/users/fbc54566b9d44261bcb980978a14bfc7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:18.740214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc54566b9d44261bcb980978a14bfc7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:18.742419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:18.816774 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc54566b9d44261bcb980978a14bfc7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.817542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc54566b9d44261bcb980978a14bfc7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.835306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc54566b9d44261bcb980978a14bfc7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.848183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc54566b9d44261bcb980978a14bfc7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.858482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-78a33a39-c710-497f-a024-106204dc8259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc54566b9d44261bcb980978a14bfc7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:18.874121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1113/2229] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:18 2022] DELETE /identity/v3/users/fbc54566b9d44261bcb980978a14bfc7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:19.291190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:19.291190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:19.298190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285c91-de68-48fd-92d1-ef6a18464001 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:19.417055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:19.417774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:19.418089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:19.418321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] PATH_INFO: `/v3/projects/958c58137761461aa38eb3488816bae1` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:19.419823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=958c58137761461aa38eb3488816bae1)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:19.422440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:19.496818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958c58137761461aa38eb3488816bae1', 'request_id': 'req-7198fa82-0e6d-401a-ae39-5278d8435bbc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:19.506960 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958c58137761461aa38eb3488816bae1', 'request_id': 'req-7198fa82-0e6d-401a-ae39-5278d8435bbc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:19.519058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958c58137761461aa38eb3488816bae1', 'request_id': 'req-7198fa82-0e6d-401a-ae39-5278d8435bbc'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:19.538719 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] The token cache is being invalidate because project 958c58137761461aa38eb3488816bae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:19.539431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:19.540464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7198fa82-0e6d-401a-ae39-5278d8435bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:19.544921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1117/2230] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:19 2022] DELETE /identity/v3/projects/958c58137761461aa38eb3488816bae1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:19.550029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb1a97-ad98-4c4b-a091-1c198943e32c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:19.550318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb1a97-ad98-4c4b-a091-1c198943e32c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:19.550618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb1a97-ad98-4c4b-a091-1c198943e32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:19.590546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d2fb1a97-ad98-4c4b-a091-1c198943e32c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:19.595778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d2fb1a97-ad98-4c4b-a091-1c198943e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:19.668146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1114/2231] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:19.684865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61f0f-7881-45d8-80b5-8b125a6b5800 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:19.688557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61f0f-7881-45d8-80b5-8b125a6b5800 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:19.688557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61f0f-7881-45d8-80b5-8b125a6b5800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:19.711172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-18e61f0f-7881-45d8-80b5-8b125a6b5800 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:19.712939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-18e61f0f-7881-45d8-80b5-8b125a6b5800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:19.727016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1118/2232] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:19.729405 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb1a97-ad98-4c4b-a091-1c198943e32c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:19.742213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb1a97-ad98-4c4b-a091-1c198943e32c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:19.747651 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3ea70-7231-4a2a-ab38-709dca662aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:19.748601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3ea70-7231-4a2a-ab38-709dca662aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:19.749052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3ea70-7231-4a2a-ab38-709dca662aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:19.749678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3ea70-7231-4a2a-ab38-709dca662aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:19.751118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3ea70-7231-4a2a-ab38-709dca662aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:42:19.751614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3ea70-7231-4a2a-ab38-709dca662aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:19.754257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3ea70-7231-4a2a-ab38-709dca662aa7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:19.768800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1115/2233] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:42:19.773881 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61f0f-7881-45d8-80b5-8b125a6b5800 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:19.784159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61f0f-7881-45d8-80b5-8b125a6b5800 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:19.788716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f61f2c-0dc2-43f8-a088-438ee2c2daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:19.789595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f61f2c-0dc2-43f8-a088-438ee2c2daec admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:19.789950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f61f2c-0dc2-43f8-a088-438ee2c2daec admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:19.792248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f61f2c-0dc2-43f8-a088-438ee2c2daec admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:19.792248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f61f2c-0dc2-43f8-a088-438ee2c2daec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:19.793775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f61f2c-0dc2-43f8-a088-438ee2c2daec admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:19.832583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1119/2234] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:19 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:19.833818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3ea70-7231-4a2a-ab38-709dca662aa7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:19.847152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3ea70-7231-4a2a-ab38-709dca662aa7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:19.870490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f61f2c-0dc2-43f8-a088-438ee2c2daec admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:19.872307 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a4f61f2c-0dc2-43f8-a088-438ee2c2daec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:19.903460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:19.923408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:19.924344 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a950243-4fa2-49bd-ab20-752bf559ee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:19.925253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a950243-4fa2-49bd-ab20-752bf559ee5a admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:19.925497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a950243-4fa2-49bd-ab20-752bf559ee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:19.925795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a950243-4fa2-49bd-ab20-752bf559ee5a admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:19.926501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a950243-4fa2-49bd-ab20-752bf559ee5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:19.928765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a950243-4fa2-49bd-ab20-752bf559ee5a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:19.958242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f61f2c-0dc2-43f8-a088-438ee2c2daec admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:19.963695 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1116/2235] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:19 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:19.966164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:19.966826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:19.967137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:19.967433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] PATH_INFO: `/v3/users/a53e967edef644a0a34eac18ff4d9038` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:19.968757 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53e967edef644a0a34eac18ff4d9038)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:19.972951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:19.973969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a950243-4fa2-49bd-ab20-752bf559ee5a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:19.988637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a950243-4fa2-49bd-ab20-752bf559ee5a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:19.993704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18646251-7103-4c57-99c9-c54a64cc2926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:19.995035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18646251-7103-4c57-99c9-c54a64cc2926 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:19.995776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18646251-7103-4c57-99c9-c54a64cc2926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:19.996510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18646251-7103-4c57-99c9-c54a64cc2926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:19.997741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18646251-7103-4c57-99c9-c54a64cc2926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:20.000575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18646251-7103-4c57-99c9-c54a64cc2926 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:20.020450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1117/2236] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:42:20.025019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18646251-7103-4c57-99c9-c54a64cc2926 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:20.033789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53e967edef644a0a34eac18ff4d9038'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.034482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53e967edef644a0a34eac18ff4d9038'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.042092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18646251-7103-4c57-99c9-c54a64cc2926 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:20.048168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97b5fe-4d3c-4254-b03d-b04e26a43af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:20.049152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53e967edef644a0a34eac18ff4d9038'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.049725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97b5fe-4d3c-4254-b03d-b04e26a43af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.050428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97b5fe-4d3c-4254-b03d-b04e26a43af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.051087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97b5fe-4d3c-4254-b03d-b04e26a43af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.052367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97b5fe-4d3c-4254-b03d-b04e26a43af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:20.055181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97b5fe-4d3c-4254-b03d-b04e26a43af6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:20.059358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53e967edef644a0a34eac18ff4d9038'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.060099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-2e7466f4-2de1-43ab-a7d8-6bca3b28a58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53e967edef644a0a34eac18ff4d9038'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.068824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1118/2237] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:20.073017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97b5fe-4d3c-4254-b03d-b04e26a43af6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:20.074975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3c97b5fe-4d3c-4254-b03d-b04e26a43af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:20.077006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1120/2238] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:19 2022] DELETE /identity/v3/users/a53e967edef644a0a34eac18ff4d9038 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:42:20.082974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60508a-d5c4-4d94-8240-7f3b89bc07dc None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.083395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60508a-d5c4-4d94-8240-7f3b89bc07dc None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.083689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60508a-d5c4-4d94-8240-7f3b89bc07dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.095070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97b5fe-4d3c-4254-b03d-b04e26a43af6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:20.112110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-5a60508a-d5c4-4d94-8240-7f3b89bc07dc None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:20.113884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5a60508a-d5c4-4d94-8240-7f3b89bc07dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:20.170976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b7b14-9fdf-4268-b09e-f5d550c2e714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:20.171892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b7b14-9fdf-4268-b09e-f5d550c2e714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.172178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b7b14-9fdf-4268-b09e-f5d550c2e714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.172457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b7b14-9fdf-4268-b09e-f5d550c2e714 admin admin] PATH_INFO: `/v3/projects/8b51e432abb042edb5cb751a682919fc/users/2d30c32a614743049d5d43d2736c589f/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.190702 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b7b14-9fdf-4268-b09e-f5d550c2e714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b51e432abb042edb5cb751a682919fc, user_id=2d30c32a614743049d5d43d2736c589f, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:20.193470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b7b14-9fdf-4268-b09e-f5d550c2e714 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:20.196942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1121/2239] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:42:20.209722 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60508a-d5c4-4d94-8240-7f3b89bc07dc None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:20.209928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1119/2240] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:20 2022] PUT /identity/v3/projects/8b51e432abb042edb5cb751a682919fc/users/2d30c32a614743049d5d43d2736c589f/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:42:20.211055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5a60508a-d5c4-4d94-8240-7f3b89bc07dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:20.221146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faf0cd-e811-4139-a86f-357a775e7afa None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.221625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faf0cd-e811-4139-a86f-357a775e7afa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.221953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faf0cd-e811-4139-a86f-357a775e7afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.257526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-16faf0cd-e811-4139-a86f-357a775e7afa None None] MFA Rules not processed for user `2d30c32a614743049d5d43d2736c589f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:20.258683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-16faf0cd-e811-4139-a86f-357a775e7afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:20.273963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60508a-d5c4-4d94-8240-7f3b89bc07dc None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:20.286558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:20.347029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1120/2241] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:42:20.348528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543c0f4-28a8-40e6-9559-799dbcf6d980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:20.349083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faf0cd-e811-4139-a86f-357a775e7afa None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:20.349378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543c0f4-28a8-40e6-9559-799dbcf6d980 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.349640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543c0f4-28a8-40e6-9559-799dbcf6d980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.349995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543c0f4-28a8-40e6-9559-799dbcf6d980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.377900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:20.419822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faf0cd-e811-4139-a86f-357a775e7afa None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:20.421662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543c0f4-28a8-40e6-9559-799dbcf6d980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:20.424800 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543c0f4-28a8-40e6-9559-799dbcf6d980 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:20.432755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33585c6c-cca8-45c2-9b66-636c3459350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:20.433705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33585c6c-cca8-45c2-9b66-636c3459350e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.434122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33585c6c-cca8-45c2-9b66-636c3459350e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.434444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33585c6c-cca8-45c2-9b66-636c3459350e admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.435327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33585c6c-cca8-45c2-9b66-636c3459350e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:20.438182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33585c6c-cca8-45c2-9b66-636c3459350e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:20.439607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1122/2242] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:20.482056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1121/2243] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:20 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:42:20.486224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543c0f4-28a8-40e6-9559-799dbcf6d980 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:20.499362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543c0f4-28a8-40e6-9559-799dbcf6d980 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:20.590947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41f42a-1ac2-40cc-ba07-b9453ca3b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:20.590947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41f42a-1ac2-40cc-ba07-b9453ca3b5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.590947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41f42a-1ac2-40cc-ba07-b9453ca3b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.590947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41f42a-1ac2-40cc-ba07-b9453ca3b5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.591428 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41f42a-1ac2-40cc-ba07-b9453ca3b5d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:20.592856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41f42a-1ac2-40cc-ba07-b9453ca3b5d5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:20.632887 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1123/2244] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:20 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:20.637225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33585c6c-cca8-45c2-9b66-636c3459350e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:20.659743 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33585c6c-cca8-45c2-9b66-636c3459350e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:20.670616 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f801d-0df6-44ea-a54f-68abf20cbecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:20.672523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f801d-0df6-44ea-a54f-68abf20cbecd admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.672883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f801d-0df6-44ea-a54f-68abf20cbecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.673140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f801d-0df6-44ea-a54f-68abf20cbecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.674388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f801d-0df6-44ea-a54f-68abf20cbecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:20.690450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f801d-0df6-44ea-a54f-68abf20cbecd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:20.716940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41f42a-1ac2-40cc-ba07-b9453ca3b5d5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:20.718894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bd41f42a-1ac2-40cc-ba07-b9453ca3b5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:20.742509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41f42a-1ac2-40cc-ba07-b9453ca3b5d5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:20.746583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1122/2245] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:20.756421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f801d-0df6-44ea-a54f-68abf20cbecd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:20.765090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:20.766109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.766591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.767190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] PATH_INFO: `/v3/projects/23092f14b3e44d1695c6625f641fd2b8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.768665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23092f14b3e44d1695c6625f641fd2b8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:20.771497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:20.783731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f801d-0df6-44ea-a54f-68abf20cbecd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:20.797702 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40066-09f8-493c-9d17-9d1a41abfdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:20.799046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40066-09f8-493c-9d17-9d1a41abfdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.799479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40066-09f8-493c-9d17-9d1a41abfdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.799763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40066-09f8-493c-9d17-9d1a41abfdb0 admin admin] PATH_INFO: `/v3/projects/78c12a1fd6d44fc6955a831ad82cc9ea/users/e4fb4e66e557464d821a26331f7f0031/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.837243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc40066-09f8-493c-9d17-9d1a41abfdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c12a1fd6d44fc6955a831ad82cc9ea, user_id=e4fb4e66e557464d821a26331f7f0031, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:20.840401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc40066-09f8-493c-9d17-9d1a41abfdb0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:20.870865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1123/2246] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:20 2022] PUT /identity/v3/projects/78c12a1fd6d44fc6955a831ad82cc9ea/users/e4fb4e66e557464d821a26331f7f0031/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:20.874071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40066-09f8-493c-9d17-9d1a41abfdb0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:20.889329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23092f14b3e44d1695c6625f641fd2b8', 'request_id': 'req-de6725d9-88f4-49f8-880c-acd0ce61d9c5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.891579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:20.912648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23092f14b3e44d1695c6625f641fd2b8', 'request_id': 'req-de6725d9-88f4-49f8-880c-acd0ce61d9c5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.929127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23092f14b3e44d1695c6625f641fd2b8', 'request_id': 'req-de6725d9-88f4-49f8-880c-acd0ce61d9c5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.960252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] The token cache is being invalidate because project 23092f14b3e44d1695c6625f641fd2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:20.960540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.961270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-de6725d9-88f4-49f8-880c-acd0ce61d9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:20.964926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1124/2247] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:20 2022] DELETE /identity/v3/projects/23092f14b3e44d1695c6625f641fd2b8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:42:20.973563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71b99-6da9-4344-a0b9-aaed4b5c7671 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:20.974120 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71b99-6da9-4344-a0b9-aaed4b5c7671 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:20.974548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71b99-6da9-4344-a0b9-aaed4b5c7671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:20.995623 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40066-09f8-493c-9d17-9d1a41abfdb0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.008331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-81f71b99-6da9-4344-a0b9-aaed4b5c7671 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:21.010642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-81f71b99-6da9-4344-a0b9-aaed4b5c7671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:21.093945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb62ae-610d-4a96-a8a7-822176a8b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.093945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb62ae-610d-4a96-a8a7-822176a8b8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.093945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb62ae-610d-4a96-a8a7-822176a8b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.093945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb62ae-610d-4a96-a8a7-822176a8b8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.094389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb62ae-610d-4a96-a8a7-822176a8b8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.097508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb62ae-610d-4a96-a8a7-822176a8b8c2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:21.118046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1124/2248] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:21.124212 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb62ae-610d-4a96-a8a7-822176a8b8c2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:21.126142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4aeb62ae-610d-4a96-a8a7-822176a8b8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:21.138617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1125/2249] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:21.147618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe26e23-f31f-4436-b997-b11f2b7853b0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.147904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe26e23-f31f-4436-b997-b11f2b7853b0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.148188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe26e23-f31f-4436-b997-b11f2b7853b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.153539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb62ae-610d-4a96-a8a7-822176a8b8c2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.159554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fe3c1-043d-4fa1-8cc1-174137928766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.160161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fe3c1-043d-4fa1-8cc1-174137928766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.160447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fe3c1-043d-4fa1-8cc1-174137928766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.160726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fe3c1-043d-4fa1-8cc1-174137928766 admin admin] PATH_INFO: `/v3/projects/78c12a1fd6d44fc6955a831ad82cc9ea/users/e4fb4e66e557464d821a26331f7f0031/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.163106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fe3c1-043d-4fa1-8cc1-174137928766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c12a1fd6d44fc6955a831ad82cc9ea, user_id=e4fb4e66e557464d821a26331f7f0031, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.174338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fe3c1-043d-4fa1-8cc1-174137928766 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:21.199645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fbe26e23-f31f-4436-b997-b11f2b7853b0 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:21.200955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fbe26e23-f31f-4436-b997-b11f2b7853b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:21.216273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1125/2250] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:21 2022] PUT /identity/v3/projects/78c12a1fd6d44fc6955a831ad82cc9ea/users/e4fb4e66e557464d821a26331f7f0031/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:21.220886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a1243-2b92-41a1-ab72-396fcf3293a1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.223308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a1243-2b92-41a1-ab72-396fcf3293a1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.223958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a1243-2b92-41a1-ab72-396fcf3293a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.243182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:21.273326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-445a1243-2b92-41a1-ab72-396fcf3293a1 None None] MFA Rules not processed for user `e4fb4e66e557464d821a26331f7f0031`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:21.275050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-445a1243-2b92-41a1-ab72-396fcf3293a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:21.311444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1126/2251] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:21.317898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe26e23-f31f-4436-b997-b11f2b7853b0 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:21.338858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe26e23-f31f-4436-b997-b11f2b7853b0 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.344395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b51f7-4a5c-4880-9f9e-dc26164f394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.345211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b51f7-4a5c-4880-9f9e-dc26164f394e admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.345594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b51f7-4a5c-4880-9f9e-dc26164f394e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.346045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b51f7-4a5c-4880-9f9e-dc26164f394e admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.347003 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b51f7-4a5c-4880-9f9e-dc26164f394e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:42:21.347621 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b51f7-4a5c-4880-9f9e-dc26164f394e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.349707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b51f7-4a5c-4880-9f9e-dc26164f394e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:21.370376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1127/2252] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:42:21.372361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b51f7-4a5c-4880-9f9e-dc26164f394e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:21.385411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b51f7-4a5c-4880-9f9e-dc26164f394e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.392804 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9201cd-47ba-4100-b455-62dbdef7fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.393715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9201cd-47ba-4100-b455-62dbdef7fb70 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.394107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9201cd-47ba-4100-b455-62dbdef7fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.396599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9201cd-47ba-4100-b455-62dbdef7fb70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.397335 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9201cd-47ba-4100-b455-62dbdef7fb70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.400278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9201cd-47ba-4100-b455-62dbdef7fb70 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:21.447026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1126/2253] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:21.458792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1128/2254] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:21 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:21.461231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a1243-2b92-41a1-ab72-396fcf3293a1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:21.462834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9201cd-47ba-4100-b455-62dbdef7fb70 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:21.467092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2f9201cd-47ba-4100-b455-62dbdef7fb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:21.489258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a1243-2b92-41a1-ab72-396fcf3293a1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.559883 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:21.580595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9201cd-47ba-4100-b455-62dbdef7fb70 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.587769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b200d-04eb-4d59-b744-b13fb240066f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.588305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b200d-04eb-4d59-b744-b13fb240066f service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.588587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b200d-04eb-4d59-b744-b13fb240066f service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.588989 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b200d-04eb-4d59-b744-b13fb240066f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.656783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d35c9-839e-4c2c-a2cc-f9d86bacbbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.657594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d35c9-839e-4c2c-a2cc-f9d86bacbbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.657965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d35c9-839e-4c2c-a2cc-f9d86bacbbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.658342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d35c9-839e-4c2c-a2cc-f9d86bacbbb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.662129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d35c9-839e-4c2c-a2cc-f9d86bacbbb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.667580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d35c9-839e-4c2c-a2cc-f9d86bacbbb2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:21.708444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b200d-04eb-4d59-b744-b13fb240066f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.710589 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b200d-04eb-4d59-b744-b13fb240066f service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:21.724736 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1129/2256] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:21.727473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1127/2256] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:21 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:42:21.728017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b200d-04eb-4d59-b744-b13fb240066f service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:21.743179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b200d-04eb-4d59-b744-b13fb240066f service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.754889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089e72-cd4b-4f3b-9207-e07b8aa055eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.757923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089e72-cd4b-4f3b-9207-e07b8aa055eb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.758522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089e72-cd4b-4f3b-9207-e07b8aa055eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.759497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089e72-cd4b-4f3b-9207-e07b8aa055eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.762432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be089e72-cd4b-4f3b-9207-e07b8aa055eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.768022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be089e72-cd4b-4f3b-9207-e07b8aa055eb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:21.797310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d35c9-839e-4c2c-a2cc-f9d86bacbbb2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:21.804186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1130/2257] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:21.808692 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089e72-cd4b-4f3b-9207-e07b8aa055eb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:21.843402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d35c9-839e-4c2c-a2cc-f9d86bacbbb2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.847778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.848443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.848723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.849005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] PATH_INFO: `/v3/users/2d30c32a614743049d5d43d2736c589f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.850302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d30c32a614743049d5d43d2736c589f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.852447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:21.856977 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089e72-cd4b-4f3b-9207-e07b8aa055eb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.872045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d556a-4aea-4e05-8c5d-84d4daa39e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.872827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d556a-4aea-4e05-8c5d-84d4daa39e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.873181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d556a-4aea-4e05-8c5d-84d4daa39e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.873528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d556a-4aea-4e05-8c5d-84d4daa39e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.874332 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d556a-4aea-4e05-8c5d-84d4daa39e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.877128 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d556a-4aea-4e05-8c5d-84d4daa39e4b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:21.905834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1131/2258] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:21.910026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d556a-4aea-4e05-8c5d-84d4daa39e4b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:21.924863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d556a-4aea-4e05-8c5d-84d4daa39e4b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:21.943571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf48702-2bc8-4e4e-b976-16ab36557b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:21.946700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf48702-2bc8-4e4e-b976-16ab36557b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:21.949159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf48702-2bc8-4e4e-b976-16ab36557b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:21.949980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf48702-2bc8-4e4e-b976-16ab36557b47 admin admin] PATH_INFO: `/v3/projects/13201c3c66be4afa8c4716b9fff315c3/users/6edff1bb210b4bf882b83feb2644dfa8/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:21.980024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d30c32a614743049d5d43d2736c589f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:21.980024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d30c32a614743049d5d43d2736c589f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:21.985993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf48702-2bc8-4e4e-b976-16ab36557b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13201c3c66be4afa8c4716b9fff315c3, user_id=6edff1bb210b4bf882b83feb2644dfa8, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:21.989503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf48702-2bc8-4e4e-b976-16ab36557b47 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:22.021408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1132/2259] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:21 2022] PUT /identity/v3/projects/13201c3c66be4afa8c4716b9fff315c3/users/6edff1bb210b4bf882b83feb2644dfa8/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:22.023411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d30c32a614743049d5d43d2736c589f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:22.024142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884ec72-c8f9-43b2-9a04-10c87cb5cd7e None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:22.024892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884ec72-c8f9-43b2-9a04-10c87cb5cd7e None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:22.025436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884ec72-c8f9-43b2-9a04-10c87cb5cd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:22.043736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d30c32a614743049d5d43d2736c589f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:22.050381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:22.060651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-c884ec72-c8f9-43b2-9a04-10c87cb5cd7e None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:22.063019 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1724192f-103f-44aa-9595-11397cdd4b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d30c32a614743049d5d43d2736c589f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:22.063402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c884ec72-c8f9-43b2-9a04-10c87cb5cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:22.074775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1128/2260] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:21 2022] DELETE /identity/v3/users/2d30c32a614743049d5d43d2736c589f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:42:22.080588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c4e4-5ebb-4f27-b89f-df5c72fe2aa6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:22.081000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c4e4-5ebb-4f27-b89f-df5c72fe2aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:22.081281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c4e4-5ebb-4f27-b89f-df5c72fe2aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:22.132565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ad62c4e4-5ebb-4f27-b89f-df5c72fe2aa6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:22.134583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ad62c4e4-5ebb-4f27-b89f-df5c72fe2aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:22.159339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1133/2261] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:22.167094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884ec72-c8f9-43b2-9a04-10c87cb5cd7e None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:22.169323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c884ec72-c8f9-43b2-9a04-10c87cb5cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:22.254081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:22.260633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884ec72-c8f9-43b2-9a04-10c87cb5cd7e None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:22.262249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1129/2262] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:22.275839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62c4e4-5ebb-4f27-b89f-df5c72fe2aa6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:22.331388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ab43d-adf4-4ff4-b721-5e294ee8e9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:22.333783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ab43d-adf4-4ff4-b721-5e294ee8e9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:22.334096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ab43d-adf4-4ff4-b721-5e294ee8e9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:22.334370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ab43d-adf4-4ff4-b721-5e294ee8e9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:22.357586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ab43d-adf4-4ff4-b721-5e294ee8e9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:22.360074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ab43d-adf4-4ff4-b721-5e294ee8e9b8 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:22.381613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1134/2263] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:22.447786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62c4e4-5ebb-4f27-b89f-df5c72fe2aa6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:22.465531 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16814634-2816-4630-b4b6-2f10e8eb522c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:22.467149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814634-2816-4630-b4b6-2f10e8eb522c service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:22.468292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814634-2816-4630-b4b6-2f10e8eb522c service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:22.468716 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814634-2816-4630-b4b6-2f10e8eb522c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:22.494741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16814634-2816-4630-b4b6-2f10e8eb522c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:22.504406 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16814634-2816-4630-b4b6-2f10e8eb522c service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:22.534572 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1130/2264] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:23.036001 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ab43d-adf4-4ff4-b721-5e294ee8e9b8 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:23.039015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-881ab43d-adf4-4ff4-b721-5e294ee8e9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:23.056223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ab43d-adf4-4ff4-b721-5e294ee8e9b8 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:23.063640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:23.064724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:23.065206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:23.065879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] PATH_INFO: `/v3/projects/8b51e432abb042edb5cb751a682919fc` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:23.067336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b51e432abb042edb5cb751a682919fc)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:23.069922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:23.212524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b51e432abb042edb5cb751a682919fc', 'request_id': 'req-e7d16933-099a-4bcf-9d1b-dee56beeedee'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.230470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b51e432abb042edb5cb751a682919fc', 'request_id': 'req-e7d16933-099a-4bcf-9d1b-dee56beeedee'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.249671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b51e432abb042edb5cb751a682919fc', 'request_id': 'req-e7d16933-099a-4bcf-9d1b-dee56beeedee'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.279026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] The token cache is being invalidate because project 8b51e432abb042edb5cb751a682919fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:23.279351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.280068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e7d16933-099a-4bcf-9d1b-dee56beeedee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.285409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1135/2265] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:23 2022] DELETE /identity/v3/projects/8b51e432abb042edb5cb751a682919fc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:23.289580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16814634-2816-4630-b4b6-2f10e8eb522c service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:23.302082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16814634-2816-4630-b4b6-2f10e8eb522c service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:23.433643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:23.434312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:23.434610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:23.434882 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] PATH_INFO: `/v3/users/e4fb4e66e557464d821a26331f7f0031` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:23.436187 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4fb4e66e557464d821a26331f7f0031)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:23.438259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:23.493139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=1,keystone:DELETE=6,keystone:SELECT=93 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:23.509260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4fb4e66e557464d821a26331f7f0031'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.510281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4fb4e66e557464d821a26331f7f0031'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.525862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4fb4e66e557464d821a26331f7f0031'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.536082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4fb4e66e557464d821a26331f7f0031'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.559287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4fb4e66e557464d821a26331f7f0031'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:23.567060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1131/2266] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:23 2022] DELETE /identity/v3/users/e4fb4e66e557464d821a26331f7f0031 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:42:24.196543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94c88-297b-42d3-ab9a-5df12a456a15 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:24.198940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94c88-297b-42d3-ab9a-5df12a456a15 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:24.199488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94c88-297b-42d3-ab9a-5df12a456a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:24.244430 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-15d94c88-297b-42d3-ab9a-5df12a456a15 None None] MFA Rules not processed for user `6edff1bb210b4bf882b83feb2644dfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:24.246830 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-15d94c88-297b-42d3-ab9a-5df12a456a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:24.373982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1136/2267] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:24.387012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:24.388836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:24.475918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af472306-85cc-42cf-87b7-ec72f693cd3f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:24.482177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc594f2b-251b-4519-ab54-952fd40f3418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:24.485268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594f2b-251b-4519-ab54-952fd40f3418 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:24.486308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594f2b-251b-4519-ab54-952fd40f3418 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:24.486686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594f2b-251b-4519-ab54-952fd40f3418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:24.510951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc594f2b-251b-4519-ab54-952fd40f3418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:24.513307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc594f2b-251b-4519-ab54-952fd40f3418 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:24.533714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1132/2268] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:24.629449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94c88-297b-42d3-ab9a-5df12a456a15 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:24.632637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-15d94c88-297b-42d3-ab9a-5df12a456a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:24.695327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:24.846054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d94c88-297b-42d3-ab9a-5df12a456a15 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:24.852806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:24.854965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:24.855483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:24.856076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] PATH_INFO: `/v3/projects/78c12a1fd6d44fc6955a831ad82cc9ea` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:24.857631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c12a1fd6d44fc6955a831ad82cc9ea)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:24.860550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:24.988749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c12a1fd6d44fc6955a831ad82cc9ea', 'request_id': 'req-1c039628-4661-4a15-8daa-16edad3ac65e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:25.005786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c12a1fd6d44fc6955a831ad82cc9ea', 'request_id': 'req-1c039628-4661-4a15-8daa-16edad3ac65e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:25.026299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c12a1fd6d44fc6955a831ad82cc9ea', 'request_id': 'req-1c039628-4661-4a15-8daa-16edad3ac65e'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:25.050315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] The token cache is being invalidate because project 78c12a1fd6d44fc6955a831ad82cc9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:25.050730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:25.052564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1c039628-4661-4a15-8daa-16edad3ac65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:25.055890 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1137/2269] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:24 2022] DELETE /identity/v3/projects/78c12a1fd6d44fc6955a831ad82cc9ea => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:25.071449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301034-1db8-4809-af96-2e772604aaf9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:25.071449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301034-1db8-4809-af96-2e772604aaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:25.071449 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301034-1db8-4809-af96-2e772604aaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:25.102637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-25301034-1db8-4809-af96-2e772604aaf9 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:25.104203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-25301034-1db8-4809-af96-2e772604aaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:25.238522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1133/2270] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:25.247580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6fed7-e19e-40d8-8af7-f6f1374acd9c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:25.248078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6fed7-e19e-40d8-8af7-f6f1374acd9c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:25.248170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6fed7-e19e-40d8-8af7-f6f1374acd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:25.276949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fad6fed7-e19e-40d8-8af7-f6f1374acd9c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:25.278221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fad6fed7-e19e-40d8-8af7-f6f1374acd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:25.289668 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1138/2271] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:42:25.295137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301034-1db8-4809-af96-2e772604aaf9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:25.306771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301034-1db8-4809-af96-2e772604aaf9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:25.315127 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ddf43-1898-483a-855b-3e5256b31103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:25.316260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ddf43-1898-483a-855b-3e5256b31103 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:25.316664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ddf43-1898-483a-855b-3e5256b31103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:25.317317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ddf43-1898-483a-855b-3e5256b31103 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:25.318233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ddf43-1898-483a-855b-3e5256b31103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:42:25.318647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ddf43-1898-483a-855b-3e5256b31103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:25.321229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ddf43-1898-483a-855b-3e5256b31103 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:25.341161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6fed7-e19e-40d8-8af7-f6f1374acd9c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:25.347992 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1134/2272] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:42:25.352293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6fed7-e19e-40d8-8af7-f6f1374acd9c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:25.364125 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7897f-f103-4043-999b-d2b24e84484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:25.365088 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7897f-f103-4043-999b-d2b24e84484d admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:25.365475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7897f-f103-4043-999b-d2b24e84484d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:25.365845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7897f-f103-4043-999b-d2b24e84484d admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:25.366592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7897f-f103-4043-999b-d2b24e84484d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:25.369975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7897f-f103-4043-999b-d2b24e84484d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:25.445776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1139/2273] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:25 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:25.452284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ddf43-1898-483a-855b-3e5256b31103 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:25.466339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ddf43-1898-483a-855b-3e5256b31103 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:25.556203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:25.585679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc48535-3b6e-4e43-bcf6-b92ae40c38b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:25.587973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc48535-3b6e-4e43-bcf6-b92ae40c38b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:25.588900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc48535-3b6e-4e43-bcf6-b92ae40c38b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:25.589341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc48535-3b6e-4e43-bcf6-b92ae40c38b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:25.590363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc48535-3b6e-4e43-bcf6-b92ae40c38b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:25.593054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc48535-3b6e-4e43-bcf6-b92ae40c38b1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:25.629351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1135/2274] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:25 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:25.633737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7897f-f103-4043-999b-d2b24e84484d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:25.650102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7897f-f103-4043-999b-d2b24e84484d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:25.655267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446178b-6ba8-4be2-9878-7fdaef6400e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:25.655962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446178b-6ba8-4be2-9878-7fdaef6400e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:25.656248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446178b-6ba8-4be2-9878-7fdaef6400e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:25.656523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446178b-6ba8-4be2-9878-7fdaef6400e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:25.658078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446178b-6ba8-4be2-9878-7fdaef6400e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:25.660122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446178b-6ba8-4be2-9878-7fdaef6400e7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:25.678487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1140/2275] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:25.682670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc48535-3b6e-4e43-bcf6-b92ae40c38b1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:25.695813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc48535-3b6e-4e43-bcf6-b92ae40c38b1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:25.702591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bee4b5-2e84-4857-838e-dc50a5f0d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:25.703341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bee4b5-2e84-4857-838e-dc50a5f0d231 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:25.703621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bee4b5-2e84-4857-838e-dc50a5f0d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:25.703986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bee4b5-2e84-4857-838e-dc50a5f0d231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:25.704801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bee4b5-2e84-4857-838e-dc50a5f0d231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:25.706436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bee4b5-2e84-4857-838e-dc50a5f0d231 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:25.725117 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1136/2276] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:25.729484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446178b-6ba8-4be2-9878-7fdaef6400e7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:25.743333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446178b-6ba8-4be2-9878-7fdaef6400e7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:25.749012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d890c3-b2a6-4c0c-a212-ee9750c14480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:25.750635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d890c3-b2a6-4c0c-a212-ee9750c14480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:25.750635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d890c3-b2a6-4c0c-a212-ee9750c14480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:25.750635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d890c3-b2a6-4c0c-a212-ee9750c14480 admin admin] PATH_INFO: `/v3/projects/c76aee7dcf3a44448cf10ebdfd33ca9f/users/379de36234f04c7987af3d729ac178b8/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:25.771520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d890c3-b2a6-4c0c-a212-ee9750c14480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76aee7dcf3a44448cf10ebdfd33ca9f, user_id=379de36234f04c7987af3d729ac178b8, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:25.774377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d890c3-b2a6-4c0c-a212-ee9750c14480 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:25.799436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1141/2277] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:25 2022] PUT /identity/v3/projects/c76aee7dcf3a44448cf10ebdfd33ca9f/users/379de36234f04c7987af3d729ac178b8/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:25.804970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b9a8e-10cf-400f-ac39-c91f221edffe None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:25.806326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b9a8e-10cf-400f-ac39-c91f221edffe None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:25.806643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b9a8e-10cf-400f-ac39-c91f221edffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:25.843903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c29b9a8e-10cf-400f-ac39-c91f221edffe None None] MFA Rules not processed for user `379de36234f04c7987af3d729ac178b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:25.845828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c29b9a8e-10cf-400f-ac39-c91f221edffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:25.943112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1137/2278] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:25.947860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d890c3-b2a6-4c0c-a212-ee9750c14480 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:26.011281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:26.045697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d890c3-b2a6-4c0c-a212-ee9750c14480 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:26.052567 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a939a36-d795-42f2-9b08-b8bf7f757ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:26.053206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a939a36-d795-42f2-9b08-b8bf7f757ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:26.054064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a939a36-d795-42f2-9b08-b8bf7f757ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:26.054344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a939a36-d795-42f2-9b08-b8bf7f757ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:26.055158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a939a36-d795-42f2-9b08-b8bf7f757ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:26.057169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a939a36-d795-42f2-9b08-b8bf7f757ea8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:26.134590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1142/2279] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:25 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:42:26.139301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b9a8e-10cf-400f-ac39-c91f221edffe None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:26.168300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b9a8e-10cf-400f-ac39-c91f221edffe None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:26.269187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaee0a-5b3f-4a41-bc94-e3f8e6c3e344 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:26.270028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaee0a-5b3f-4a41-bc94-e3f8e6c3e344 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:26.270495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaee0a-5b3f-4a41-bc94-e3f8e6c3e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:26.293685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b4eaee0a-5b3f-4a41-bc94-e3f8e6c3e344 None None] MFA Rules not processed for user `6edff1bb210b4bf882b83feb2644dfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:26.294930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b4eaee0a-5b3f-4a41-bc94-e3f8e6c3e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:26.297909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4564b0-feba-4095-b867-ce842fe7caa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:26.299311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4564b0-feba-4095-b867-ce842fe7caa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:26.299751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4564b0-feba-4095-b867-ce842fe7caa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:26.300110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4564b0-feba-4095-b867-ce842fe7caa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:26.301261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4564b0-feba-4095-b867-ce842fe7caa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:26.303279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4564b0-feba-4095-b867-ce842fe7caa0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:26.339042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1138/2280] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:26 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:26.341767 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4564b0-feba-4095-b867-ce842fe7caa0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:26.353448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4564b0-feba-4095-b867-ce842fe7caa0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:26.359088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb262b2d-5236-4e94-a005-62bed855ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:26.359765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb262b2d-5236-4e94-a005-62bed855ede5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:26.361404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb262b2d-5236-4e94-a005-62bed855ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:26.361404 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb262b2d-5236-4e94-a005-62bed855ede5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:26.361870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb262b2d-5236-4e94-a005-62bed855ede5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:26.363989 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb262b2d-5236-4e94-a005-62bed855ede5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:26.379308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1139/2281] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:26.380256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb262b2d-5236-4e94-a005-62bed855ede5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:26.383916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1143/2282] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:42:26.405201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb262b2d-5236-4e94-a005-62bed855ede5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:26.411679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2793f1-25a7-430c-b682-5abfc745b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:26.412521 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2793f1-25a7-430c-b682-5abfc745b79a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:26.412805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2793f1-25a7-430c-b682-5abfc745b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:26.413161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2793f1-25a7-430c-b682-5abfc745b79a admin admin] PATH_INFO: `/v3/projects/8e59178078f5499a8698ff22010759ac/users/c34218c9a9074b98a3d950acbe3ae4a8/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:26.431260 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2793f1-25a7-430c-b682-5abfc745b79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e59178078f5499a8698ff22010759ac, user_id=c34218c9a9074b98a3d950acbe3ae4a8, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:26.434408 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2793f1-25a7-430c-b682-5abfc745b79a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:26.457029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1140/2283] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:26 2022] PUT /identity/v3/projects/8e59178078f5499a8698ff22010759ac/users/c34218c9a9074b98a3d950acbe3ae4a8/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:26.462509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaee0a-5b3f-4a41-bc94-e3f8e6c3e344 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:26.484318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaee0a-5b3f-4a41-bc94-e3f8e6c3e344 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:26.579151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc79d0-39fe-4f13-9913-2882c8e61bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:26.580482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc79d0-39fe-4f13-9913-2882c8e61bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:26.580912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc79d0-39fe-4f13-9913-2882c8e61bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:26.581195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc79d0-39fe-4f13-9913-2882c8e61bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:26.581909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc79d0-39fe-4f13-9913-2882c8e61bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:26.594226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc79d0-39fe-4f13-9913-2882c8e61bdb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:26.599156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1144/2284] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:42:26.603042 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2793f1-25a7-430c-b682-5abfc745b79a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:26.614423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2793f1-25a7-430c-b682-5abfc745b79a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:26.619757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dc790-e84a-44e1-aa9f-21644b40f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:26.620354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc790-e84a-44e1-aa9f-21644b40f33c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:26.620631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc790-e84a-44e1-aa9f-21644b40f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:26.620913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc790-e84a-44e1-aa9f-21644b40f33c admin admin] PATH_INFO: `/v3/projects/8e59178078f5499a8698ff22010759ac/users/c34218c9a9074b98a3d950acbe3ae4a8/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:26.623318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dc790-e84a-44e1-aa9f-21644b40f33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e59178078f5499a8698ff22010759ac, user_id=c34218c9a9074b98a3d950acbe3ae4a8, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:26.625974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dc790-e84a-44e1-aa9f-21644b40f33c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:26.628807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:26.640822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1141/2285] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:26 2022] PUT /identity/v3/projects/8e59178078f5499a8698ff22010759ac/users/c34218c9a9074b98a3d950acbe3ae4a8/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:26.655599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b1a32-aaa4-4c1a-bb81-ce17b94e7072 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:26.655898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b1a32-aaa4-4c1a-bb81-ce17b94e7072 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:26.656174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b1a32-aaa4-4c1a-bb81-ce17b94e7072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:26.693653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a14b1a32-aaa4-4c1a-bb81-ce17b94e7072 None None] MFA Rules not processed for user `c34218c9a9074b98a3d950acbe3ae4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:26.694924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a14b1a32-aaa4-4c1a-bb81-ce17b94e7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:26.842898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:26.849203 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1145/2286] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:26.864632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dc790-e84a-44e1-aa9f-21644b40f33c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:26.866478 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c27dc790-e84a-44e1-aa9f-21644b40f33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:26.932725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dc790-e84a-44e1-aa9f-21644b40f33c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:26.939201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb36a2-ba88-4b5d-9b90-5bab8c67143d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:26.939841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb36a2-ba88-4b5d-9b90-5bab8c67143d service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:26.940118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb36a2-ba88-4b5d-9b90-5bab8c67143d service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:26.940387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb36a2-ba88-4b5d-9b90-5bab8c67143d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:27.007579 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb36a2-ba88-4b5d-9b90-5bab8c67143d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:27.009399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb36a2-ba88-4b5d-9b90-5bab8c67143d service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:27.020987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1142/2287] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:28.558851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b1a32-aaa4-4c1a-bb81-ce17b94e7072 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:28.560494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a14b1a32-aaa4-4c1a-bb81-ce17b94e7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:28.582205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b1a32-aaa4-4c1a-bb81-ce17b94e7072 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:28.586732 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897dc79-df5a-4433-96b1-e9f21d5c7ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:28.587600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897dc79-df5a-4433-96b1-e9f21d5c7ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:28.587833 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897dc79-df5a-4433-96b1-e9f21d5c7ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:28.588042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897dc79-df5a-4433-96b1-e9f21d5c7ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:28.599740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897dc79-df5a-4433-96b1-e9f21d5c7ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:28.601106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897dc79-df5a-4433-96b1-e9f21d5c7ee0 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:28.612327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1146/2288] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:29.323051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb36a2-ba88-4b5d-9b90-5bab8c67143d service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:29.324637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21eb36a2-ba88-4b5d-9b90-5bab8c67143d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:29.416835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb36a2-ba88-4b5d-9b90-5bab8c67143d service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:29.422175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:29.422887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:29.423200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:29.423471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] PATH_INFO: `/v3/users/e529c49ecd9941f4b95655de1d702fe5` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:29.424674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e529c49ecd9941f4b95655de1d702fe5)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:29.426790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:29.482850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e529c49ecd9941f4b95655de1d702fe5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:29.483544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e529c49ecd9941f4b95655de1d702fe5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:29.485494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=1,keystone:SELECT=92,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:29.509537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e529c49ecd9941f4b95655de1d702fe5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:29.522647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e529c49ecd9941f4b95655de1d702fe5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:29.534611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e529c49ecd9941f4b95655de1d702fe5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:29.545588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1143/2289] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:29 2022] DELETE /identity/v3/users/e529c49ecd9941f4b95655de1d702fe5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:29.550716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b063b-b608-45b5-b2c4-f334009ba458 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:29.551165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b063b-b608-45b5-b2c4-f334009ba458 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:29.551537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b063b-b608-45b5-b2c4-f334009ba458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:29.576735 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ef6b063b-b608-45b5-b2c4-f334009ba458 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:29.580067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ef6b063b-b608-45b5-b2c4-f334009ba458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:29.612471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:29.613929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:29.666148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1147/2290] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:29.675899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b063b-b608-45b5-b2c4-f334009ba458 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:29.679247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ef6b063b-b608-45b5-b2c4-f334009ba458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:29.824659 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1869b-ea1c-483f-8f67-15748b815e77 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:29.837788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:29.838665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:29.838665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:29.839454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] PATH_INFO: `/v3/users/53d8f720ad8b4b98951973ad892dd059` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:29.840913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d8f720ad8b4b98951973ad892dd059)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:29.843780 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:29.850768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b063b-b608-45b5-b2c4-f334009ba458 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:29.858902 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623069bf-eb88-4693-a614-185056ecb6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:29.859143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623069bf-eb88-4693-a614-185056ecb6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:29.859416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623069bf-eb88-4693-a614-185056ecb6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:29.863072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623069bf-eb88-4693-a614-185056ecb6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:29.879622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623069bf-eb88-4693-a614-185056ecb6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:29.881646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623069bf-eb88-4693-a614-185056ecb6d3 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:29.896162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1148/2291] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:29.935142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d8f720ad8b4b98951973ad892dd059'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:29.936783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d8f720ad8b4b98951973ad892dd059'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:29.973337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d8f720ad8b4b98951973ad892dd059'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:29.988233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d8f720ad8b4b98951973ad892dd059'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:30.039805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2a66338e-b5db-46c3-b58c-1674ae546ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d8f720ad8b4b98951973ad892dd059'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:30.069232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1144/2292] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:29 2022] DELETE /identity/v3/users/53d8f720ad8b4b98951973ad892dd059 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:30.074356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20270e-07b1-4bea-8afa-943677ab4eaf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:30.074916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20270e-07b1-4bea-8afa-943677ab4eaf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:30.075408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20270e-07b1-4bea-8afa-943677ab4eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:30.117602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ed20270e-07b1-4bea-8afa-943677ab4eaf None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:30.119651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ed20270e-07b1-4bea-8afa-943677ab4eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:30.256465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd8a4-a017-4155-877c-8a2f1aab2c69 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:30.256758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd8a4-a017-4155-877c-8a2f1aab2c69 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:30.257023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd8a4-a017-4155-877c-8a2f1aab2c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:30.292014 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1149/2293] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:42:30.316698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20270e-07b1-4bea-8afa-943677ab4eaf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:30.318300 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ed20270e-07b1-4bea-8afa-943677ab4eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:30.331156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d82cd8a4-a017-4155-877c-8a2f1aab2c69 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:30.332740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d82cd8a4-a017-4155-877c-8a2f1aab2c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:30.421147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:30.483689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20270e-07b1-4bea-8afa-943677ab4eaf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:30.495976 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca72f77-4dbb-44cc-9760-504745172416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:30.499298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72f77-4dbb-44cc-9760-504745172416 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:30.501714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:30.502731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72f77-4dbb-44cc-9760-504745172416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:30.504502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72f77-4dbb-44cc-9760-504745172416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:30.541059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1145/2294] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:42:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:30.553067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca72f77-4dbb-44cc-9760-504745172416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:30.554761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca72f77-4dbb-44cc-9760-504745172416 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:30.559170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd8a4-a017-4155-877c-8a2f1aab2c69 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:30.561395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d82cd8a4-a017-4155-877c-8a2f1aab2c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:30.571505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1150/2295] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:30.677704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd8a4-a017-4155-877c-8a2f1aab2c69 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:30.684346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264d848-e7ef-4fe6-b622-5bf3fb87d34e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:30.684980 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264d848-e7ef-4fe6-b622-5bf3fb87d34e service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:30.685286 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264d848-e7ef-4fe6-b622-5bf3fb87d34e service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:30.685553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264d848-e7ef-4fe6-b622-5bf3fb87d34e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:30.696490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264d848-e7ef-4fe6-b622-5bf3fb87d34e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:30.704349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264d848-e7ef-4fe6-b622-5bf3fb87d34e service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:30.722486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1146/2296] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:42:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 04:42:31.068801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca72f77-4dbb-44cc-9760-504745172416 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:31.070754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-eca72f77-4dbb-44cc-9760-504745172416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:31.098187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca72f77-4dbb-44cc-9760-504745172416 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:31.114601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:31.115662 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:31.116358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:31.116784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] PATH_INFO: `/v3/projects/8bcee9d830ce421c9594f8f436c2494d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:31.118771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcee9d830ce421c9594f8f436c2494d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:31.121221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:31.242782 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcee9d830ce421c9594f8f436c2494d', 'request_id': 'req-e438fe60-113a-4f6f-9e85-d062536409b9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:31.251911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcee9d830ce421c9594f8f436c2494d', 'request_id': 'req-e438fe60-113a-4f6f-9e85-d062536409b9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:31.271102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcee9d830ce421c9594f8f436c2494d', 'request_id': 'req-e438fe60-113a-4f6f-9e85-d062536409b9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:31.291171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] The token cache is being invalidate because project 8bcee9d830ce421c9594f8f436c2494d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:31.291590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:31.292386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e438fe60-113a-4f6f-9e85-d062536409b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:31.294638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1151/2297] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:31 2022] DELETE /identity/v3/projects/8bcee9d830ce421c9594f8f436c2494d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:31.301818 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c3889-6c2d-4836-bc95-17c7e03199bf None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:31.302310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c3889-6c2d-4836-bc95-17c7e03199bf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:31.302838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c3889-6c2d-4836-bc95-17c7e03199bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:31.382711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-aa7c3889-6c2d-4836-bc95-17c7e03199bf None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:31.384003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aa7c3889-6c2d-4836-bc95-17c7e03199bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:31.618176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd74fb-8f69-403a-a7a0-bdc278e9db27 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:31.618553 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd74fb-8f69-403a-a7a0-bdc278e9db27 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:31.618682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1147/2298] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:31.618831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd74fb-8f69-403a-a7a0-bdc278e9db27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:31.668571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c3889-6c2d-4836-bc95-17c7e03199bf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:31.670506 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-aa7c3889-6c2d-4836-bc95-17c7e03199bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:31.673405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6acd74fb-8f69-403a-a7a0-bdc278e9db27 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:31.680624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6acd74fb-8f69-403a-a7a0-bdc278e9db27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:31.704045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1152/2299] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:42:31.706977 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd74fb-8f69-403a-a7a0-bdc278e9db27 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:31.708356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c3889-6c2d-4836-bc95-17c7e03199bf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:31.721601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd74fb-8f69-403a-a7a0-bdc278e9db27 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:31.728917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:31.728917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:31.728917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:31.728917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] PATH_INFO: `/v3/projects/db3167f6eaa047a398fa1065656451b1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:31.730387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d50fa-686c-44e9-aaa8-313506dce9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:31.731775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d50fa-686c-44e9-aaa8-313506dce9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:31.732277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d50fa-686c-44e9-aaa8-313506dce9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:31.733593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d50fa-686c-44e9-aaa8-313506dce9f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:31.734463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d50fa-686c-44e9-aaa8-313506dce9f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:42:31.734885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d50fa-686c-44e9-aaa8-313506dce9f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:31.737637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d50fa-686c-44e9-aaa8-313506dce9f9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:31.750101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3167f6eaa047a398fa1065656451b1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:31.765952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1153/2300] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:42:31.769970 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d50fa-686c-44e9-aaa8-313506dce9f9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:31.770152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:31.807792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d50fa-686c-44e9-aaa8-313506dce9f9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:31.830335 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f95ef-3351-47b3-a796-022bec97a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:31.831111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f95ef-3351-47b3-a796-022bec97a25b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:31.831389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f95ef-3351-47b3-a796-022bec97a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:31.831655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f95ef-3351-47b3-a796-022bec97a25b admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:31.833544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f95ef-3351-47b3-a796-022bec97a25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:31.834231 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f95ef-3351-47b3-a796-022bec97a25b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:31.912399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3167f6eaa047a398fa1065656451b1', 'request_id': 'req-2427cc34-b6f0-443c-8e4f-d28084def877'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:31.931432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1154/2301] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:31 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:31.936728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3167f6eaa047a398fa1065656451b1', 'request_id': 'req-2427cc34-b6f0-443c-8e4f-d28084def877'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:31.936857 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f95ef-3351-47b3-a796-022bec97a25b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:31.968290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3167f6eaa047a398fa1065656451b1', 'request_id': 'req-2427cc34-b6f0-443c-8e4f-d28084def877'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:32.057733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] The token cache is being invalidate because project db3167f6eaa047a398fa1065656451b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:32.058022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:32.065740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2427cc34-b6f0-443c-8e4f-d28084def877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:32.074756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1148/2302] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:31 2022] DELETE /identity/v3/projects/db3167f6eaa047a398fa1065656451b1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:42:32.076248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f48d8-2f39-4678-8560-f9a8ae8d63d1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.077053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f48d8-2f39-4678-8560-f9a8ae8d63d1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.077053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f48d8-2f39-4678-8560-f9a8ae8d63d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.113920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:32.159970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a05f48d8-2f39-4678-8560-f9a8ae8d63d1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:32.169399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a05f48d8-2f39-4678-8560-f9a8ae8d63d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:32.174795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f95ef-3351-47b3-a796-022bec97a25b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:32.199321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe66d1f-f182-4258-92d7-dd1e889997d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:32.204313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe66d1f-f182-4258-92d7-dd1e889997d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.204771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe66d1f-f182-4258-92d7-dd1e889997d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.208159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe66d1f-f182-4258-92d7-dd1e889997d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.208972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe66d1f-f182-4258-92d7-dd1e889997d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:32.215605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1149/2303] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:32.227212 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a06b21-a612-4f8e-86dd-fa1960af9156 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.227500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a06b21-a612-4f8e-86dd-fa1960af9156 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.230155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe66d1f-f182-4258-92d7-dd1e889997d4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:32.234083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a06b21-a612-4f8e-86dd-fa1960af9156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.335597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1155/2304] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:31 2022] POST /identity/v3/users => generated 284 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:32.338810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-71a06b21-a612-4f8e-86dd-fa1960af9156 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:32.340102 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-71a06b21-a612-4f8e-86dd-fa1960af9156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:32.342215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe66d1f-f182-4258-92d7-dd1e889997d4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:32.350111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dbe66d1f-f182-4258-92d7-dd1e889997d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:32.375327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1150/2305] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:32.376910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:32.381739 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a06b21-a612-4f8e-86dd-fa1960af9156 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:32.391876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe66d1f-f182-4258-92d7-dd1e889997d4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:32.407302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514a57-898c-4677-b711-3e9a7eff6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:32.408028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514a57-898c-4677-b711-3e9a7eff6374 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.408471 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a06b21-a612-4f8e-86dd-fa1960af9156 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:32.409261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514a57-898c-4677-b711-3e9a7eff6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.409947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514a57-898c-4677-b711-3e9a7eff6374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.412368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e514a57-898c-4677-b711-3e9a7eff6374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:32.417826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e514a57-898c-4677-b711-3e9a7eff6374 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:32.420493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f69cd5-c280-45d3-a2ff-325c8a34d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:32.421252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f69cd5-c280-45d3-a2ff-325c8a34d4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.422493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f69cd5-c280-45d3-a2ff-325c8a34d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.422907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f69cd5-c280-45d3-a2ff-325c8a34d4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.425771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f69cd5-c280-45d3-a2ff-325c8a34d4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:42:32.426196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f69cd5-c280-45d3-a2ff-325c8a34d4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:32.430573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f69cd5-c280-45d3-a2ff-325c8a34d4ff admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:32.450100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1156/2306] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:32.454110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514a57-898c-4677-b711-3e9a7eff6374 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:32.468105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1151/2307] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:42:32.473014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f69cd5-c280-45d3-a2ff-325c8a34d4ff admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:32.475254 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514a57-898c-4677-b711-3e9a7eff6374 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:32.490695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e623825-c999-4506-ab47-20b72954987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:32.495319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e623825-c999-4506-ab47-20b72954987b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.495897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e623825-c999-4506-ab47-20b72954987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.496144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e623825-c999-4506-ab47-20b72954987b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.497100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e623825-c999-4506-ab47-20b72954987b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:32.498905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f69cd5-c280-45d3-a2ff-325c8a34d4ff admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:32.502323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e623825-c999-4506-ab47-20b72954987b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:32.517086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e238212-6525-4034-b61f-c471381d8593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:32.520476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e238212-6525-4034-b61f-c471381d8593 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.525953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e238212-6525-4034-b61f-c471381d8593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.526370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e238212-6525-4034-b61f-c471381d8593 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.527119 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e238212-6525-4034-b61f-c471381d8593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:32.529242 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e238212-6525-4034-b61f-c471381d8593 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:32.539233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1157/2308] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:42:32.541218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e623825-c999-4506-ab47-20b72954987b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:32.582032 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e623825-c999-4506-ab47-20b72954987b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:32.604083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d142b9-e45b-4e9d-b415-4a654668d821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:32.606175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d142b9-e45b-4e9d-b415-4a654668d821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.606850 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d142b9-e45b-4e9d-b415-4a654668d821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.607571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1152/2309] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:32 2022] POST /identity/v3/projects => generated 391 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:32.607842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d142b9-e45b-4e9d-b415-4a654668d821 admin admin] PATH_INFO: `/v3/projects/9c22a2c1cd0145778a041f3ca0f9ef7e/users/a51a44fbcfca4e509d82c48432b549d8/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.612756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e238212-6525-4034-b61f-c471381d8593 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:32.637177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d142b9-e45b-4e9d-b415-4a654668d821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c22a2c1cd0145778a041f3ca0f9ef7e, user_id=a51a44fbcfca4e509d82c48432b549d8, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:32.641321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d142b9-e45b-4e9d-b415-4a654668d821 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:32.696063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1158/2310] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:32 2022] PUT /identity/v3/projects/9c22a2c1cd0145778a041f3ca0f9ef7e/users/a51a44fbcfca4e509d82c48432b549d8/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:32.708468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536be4af-a2d3-4039-aece-b6cb5def875c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.708746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536be4af-a2d3-4039-aece-b6cb5def875c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.709004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536be4af-a2d3-4039-aece-b6cb5def875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.771755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e238212-6525-4034-b61f-c471381d8593 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:32.793018 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-536be4af-a2d3-4039-aece-b6cb5def875c None None] MFA Rules not processed for user `a51a44fbcfca4e509d82c48432b549d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:32.794293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-536be4af-a2d3-4039-aece-b6cb5def875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:32.936256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e5c93-8f15-4f6c-b84a-50f0492874fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:32.937020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e5c93-8f15-4f6c-b84a-50f0492874fb admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:32.937308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e5c93-8f15-4f6c-b84a-50f0492874fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:32.937578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e5c93-8f15-4f6c-b84a-50f0492874fb admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:32.939045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e5c93-8f15-4f6c-b84a-50f0492874fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:32.945435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e5c93-8f15-4f6c-b84a-50f0492874fb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:33.003135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1153/2311] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:32 2022] POST /identity/v3/users => generated 296 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:33.008558 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e5c93-8f15-4f6c-b84a-50f0492874fb admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:33.024229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1159/2312] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:33.031486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e5c93-8f15-4f6c-b84a-50f0492874fb admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:33.038802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536be4af-a2d3-4039-aece-b6cb5def875c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:33.040783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-536be4af-a2d3-4039-aece-b6cb5def875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:33.054906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2aa1da-1bee-4e14-b3ec-e5913966c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:33.055868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2aa1da-1bee-4e14-b3ec-e5913966c301 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:33.056158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2aa1da-1bee-4e14-b3ec-e5913966c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:33.056428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2aa1da-1bee-4e14-b3ec-e5913966c301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:33.057581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2aa1da-1bee-4e14-b3ec-e5913966c301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:33.059099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2aa1da-1bee-4e14-b3ec-e5913966c301 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:33.087940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1154/2313] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:42:33.090489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2aa1da-1bee-4e14-b3ec-e5913966c301 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:33.125625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2aa1da-1bee-4e14-b3ec-e5913966c301 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:33.138445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78216884-09a0-4600-a46f-2f9dd8fa21d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:33.143203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78216884-09a0-4600-a46f-2f9dd8fa21d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:33.143431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78216884-09a0-4600-a46f-2f9dd8fa21d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:33.143715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78216884-09a0-4600-a46f-2f9dd8fa21d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:33.144529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78216884-09a0-4600-a46f-2f9dd8fa21d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:33.146181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78216884-09a0-4600-a46f-2f9dd8fa21d8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:33.171567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1155/2314] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:33.175916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78216884-09a0-4600-a46f-2f9dd8fa21d8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:33.196258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78216884-09a0-4600-a46f-2f9dd8fa21d8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:33.220250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b112a8-a9d3-4c33-a763-b627139ecafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:33.220954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b112a8-a9d3-4c33-a763-b627139ecafa admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:33.221230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b112a8-a9d3-4c33-a763-b627139ecafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:33.221496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b112a8-a9d3-4c33-a763-b627139ecafa admin admin] PATH_INFO: `/v3/projects/8625f2e289234eca8ba3c74ee293d439/users/8073e820e4e8406a98962e6809a21730/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:33.275237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b112a8-a9d3-4c33-a763-b627139ecafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8625f2e289234eca8ba3c74ee293d439, user_id=8073e820e4e8406a98962e6809a21730, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:33.278015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b112a8-a9d3-4c33-a763-b627139ecafa admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:33.279419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536be4af-a2d3-4039-aece-b6cb5def875c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:33.291151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e700f9e-bba0-492c-85bc-02973f332153 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955c6cb8893c473fadd028b12bbea69d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:33.291982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e700f9e-bba0-492c-85bc-02973f332153 service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:33.292403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e700f9e-bba0-492c-85bc-02973f332153 service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:33.292809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e700f9e-bba0-492c-85bc-02973f332153 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:33.321725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e700f9e-bba0-492c-85bc-02973f332153 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:33.323497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e700f9e-bba0-492c-85bc-02973f332153 service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:33.334125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1156/2315] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:33 2022] PUT /identity/v3/projects/8625f2e289234eca8ba3c74ee293d439/users/8073e820e4e8406a98962e6809a21730/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:33.337088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b112a8-a9d3-4c33-a763-b627139ecafa admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:33.344209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1160/2316] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:33.345360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-78b112a8-a9d3-4c33-a763-b627139ecafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:33.363483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9af2a-7acd-4dba-adbf-daf7a6d0615d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:33.363780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9af2a-7acd-4dba-adbf-daf7a6d0615d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:33.370343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9af2a-7acd-4dba-adbf-daf7a6d0615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:33.372279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:33.509754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b112a8-a9d3-4c33-a763-b627139ecafa admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:33.522220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-38b9af2a-7acd-4dba-adbf-daf7a6d0615d None None] MFA Rules not processed for user `8073e820e4e8406a98962e6809a21730`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:33.523598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:33.525677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-38b9af2a-7acd-4dba-adbf-daf7a6d0615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:33.527273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:33.527602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:33.528508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] PATH_INFO: `/v3/users/379de36234f04c7987af3d729ac178b8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:33.531120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=379de36234f04c7987af3d729ac178b8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:33.538497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:33.652472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:33.742097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1161/2317] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:33.745214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379de36234f04c7987af3d729ac178b8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:33.758880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379de36234f04c7987af3d729ac178b8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:33.768290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9af2a-7acd-4dba-adbf-daf7a6d0615d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:33.770472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-38b9af2a-7acd-4dba-adbf-daf7a6d0615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:33.800059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379de36234f04c7987af3d729ac178b8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:33.820430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379de36234f04c7987af3d729ac178b8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:33.837435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03c8e213-ae42-4dd1-9315-99d6fdbcd50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379de36234f04c7987af3d729ac178b8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:33.849748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1157/2318] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:33 2022] DELETE /identity/v3/users/379de36234f04c7987af3d729ac178b8 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:33.856976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7371ae3-063d-4845-b69a-9ff73f6975e7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:33.857259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7371ae3-063d-4845-b69a-9ff73f6975e7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:33.857532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7371ae3-063d-4845-b69a-9ff73f6975e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:33.893867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a7371ae3-063d-4845-b69a-9ff73f6975e7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:33.896282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a7371ae3-063d-4845-b69a-9ff73f6975e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:33.949932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9af2a-7acd-4dba-adbf-daf7a6d0615d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:34.054865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1158/2319] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:34.077714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:34.078398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:34.080497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:34.080860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:34.090844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:34.127199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7371ae3-063d-4845-b69a-9ff73f6975e7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:34.128641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a7371ae3-063d-4845-b69a-9ff73f6975e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:34.209510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:34.211837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:34.225884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1162/2320] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:34.246060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:34.330084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7371ae3-063d-4845-b69a-9ff73f6975e7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:34.346050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce2a36-b127-49a8-b48c-6283e0dcc7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:34.347244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce2a36-b127-49a8-b48c-6283e0dcc7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:34.348878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce2a36-b127-49a8-b48c-6283e0dcc7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:34.349522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce2a36-b127-49a8-b48c-6283e0dcc7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:34.375502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce2a36-b127-49a8-b48c-6283e0dcc7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:34.379273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce2a36-b127-49a8-b48c-6283e0dcc7c1 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:34.421435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1159/2321] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:35.383222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:35.385211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:35.408201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a209-67e8-42e2-8d53-e40d83b4733c service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:35.414495 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:35.415688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:35.415966 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:35.416237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] PATH_INFO: `/v3/projects/c76aee7dcf3a44448cf10ebdfd33ca9f` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:35.420435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76aee7dcf3a44448cf10ebdfd33ca9f)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:35.424584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:35.514315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:35.536034 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76aee7dcf3a44448cf10ebdfd33ca9f', 'request_id': 'req-42e33a93-bcda-4383-9216-76b570a0b0c7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:35.561189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76aee7dcf3a44448cf10ebdfd33ca9f', 'request_id': 'req-42e33a93-bcda-4383-9216-76b570a0b0c7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:35.587019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76aee7dcf3a44448cf10ebdfd33ca9f', 'request_id': 'req-42e33a93-bcda-4383-9216-76b570a0b0c7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:35.616462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] The token cache is being invalidate because project c76aee7dcf3a44448cf10ebdfd33ca9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:35.617053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:35.618179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:35.623669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1163/2322] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:35 2022] DELETE /identity/v3/projects/c76aee7dcf3a44448cf10ebdfd33ca9f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:35.630249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce2a36-b127-49a8-b48c-6283e0dcc7c1 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:35.662729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce2a36-b127-49a8-b48c-6283e0dcc7c1 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:35.828434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:35.829940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:35.830396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:35.830834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] PATH_INFO: `/v3/users/c34218c9a9074b98a3d950acbe3ae4a8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:35.835638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34218c9a9074b98a3d950acbe3ae4a8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:35.841860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:35.956183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34218c9a9074b98a3d950acbe3ae4a8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:35.957269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34218c9a9074b98a3d950acbe3ae4a8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:35.988226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34218c9a9074b98a3d950acbe3ae4a8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:36.003759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34218c9a9074b98a3d950acbe3ae4a8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:36.021279 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d5c28159-63ee-4c87-b25d-977337e058b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34218c9a9074b98a3d950acbe3ae4a8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:36.036522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1160/2323] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:35 2022] DELETE /identity/v3/users/c34218c9a9074b98a3d950acbe3ae4a8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:36.754278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:36.759293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:36.820357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e33a93-bcda-4383-9216-76b570a0b0c7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:37.008416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:37.020750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.021328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.021783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] PATH_INFO: `/v3/projects/8e59178078f5499a8698ff22010759ac` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:37.023632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e59178078f5499a8698ff22010759ac)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:37.025578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:37.142646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e59178078f5499a8698ff22010759ac', 'request_id': 'req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:37.154853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e59178078f5499a8698ff22010759ac', 'request_id': 'req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:37.168983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e59178078f5499a8698ff22010759ac', 'request_id': 'req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:37.189840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] The token cache is being invalidate because project 8e59178078f5499a8698ff22010759ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:37.190306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:37.191068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-296d4a1b-fb35-4c5a-a0b1-9710b4ab3a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:37.201071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1164/2324] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:36 2022] DELETE /identity/v3/projects/8e59178078f5499a8698ff22010759ac => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:37.203043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcce67-f066-4a23-b09f-bea2dc9f58a2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.203562 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcce67-f066-4a23-b09f-bea2dc9f58a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.204171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcce67-f066-4a23-b09f-bea2dc9f58a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:37.235456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c5fcce67-f066-4a23-b09f-bea2dc9f58a2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:37.236752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c5fcce67-f066-4a23-b09f-bea2dc9f58a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:37.306135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:37.338352 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1161/2325] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:37.346319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858294e-804f-410e-b8c9-0beefb9a7772 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.346602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858294e-804f-410e-b8c9-0beefb9a7772 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.346877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858294e-804f-410e-b8c9-0beefb9a7772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:37.380387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-7858294e-804f-410e-b8c9-0beefb9a7772 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:37.381017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7858294e-804f-410e-b8c9-0beefb9a7772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:37.402629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1165/2326] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:37.403916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcce67-f066-4a23-b09f-bea2dc9f58a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:37.421779 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcce67-f066-4a23-b09f-bea2dc9f58a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:37.444838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03b4d0-6287-42d2-93de-e988f9187ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:37.448369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b4d0-6287-42d2-93de-e988f9187ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.448681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b4d0-6287-42d2-93de-e988f9187ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.449121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b4d0-6287-42d2-93de-e988f9187ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:37.449868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03b4d0-6287-42d2-93de-e988f9187ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:42:37.450178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03b4d0-6287-42d2-93de-e988f9187ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:37.451921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03b4d0-6287-42d2-93de-e988f9187ee1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:37.466317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1162/2327] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:42:37.473246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858294e-804f-410e-b8c9-0beefb9a7772 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:37.482493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858294e-804f-410e-b8c9-0beefb9a7772 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:37.489451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036d914-4ecf-4da5-b4c0-cf4c329da1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:37.490180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d914-4ecf-4da5-b4c0-cf4c329da1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.490465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d914-4ecf-4da5-b4c0-cf4c329da1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.490741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d914-4ecf-4da5-b4c0-cf4c329da1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:37.491458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036d914-4ecf-4da5-b4c0-cf4c329da1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:37.493388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036d914-4ecf-4da5-b4c0-cf4c329da1c3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:37.532807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1166/2328] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:37 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:37.537805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03b4d0-6287-42d2-93de-e988f9187ee1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:37.555570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03b4d0-6287-42d2-93de-e988f9187ee1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:37.663424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932a04b-8946-45ac-8b65-dd558c254e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:37.664731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932a04b-8946-45ac-8b65-dd558c254e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.665310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932a04b-8946-45ac-8b65-dd558c254e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.666220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932a04b-8946-45ac-8b65-dd558c254e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:37.667078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932a04b-8946-45ac-8b65-dd558c254e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:37.670085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932a04b-8946-45ac-8b65-dd558c254e06 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:37.704962 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1163/2329] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:37 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:37.708916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036d914-4ecf-4da5-b4c0-cf4c329da1c3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:37.722177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036d914-4ecf-4da5-b4c0-cf4c329da1c3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:37.727743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4282a-eb98-450c-8554-febf45c823e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:37.728411 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4282a-eb98-450c-8554-febf45c823e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.728698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4282a-eb98-450c-8554-febf45c823e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.729093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4282a-eb98-450c-8554-febf45c823e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:37.729798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4282a-eb98-450c-8554-febf45c823e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:37.732074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4282a-eb98-450c-8554-febf45c823e2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:37.750569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1167/2330] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:37.766888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932a04b-8946-45ac-8b65-dd558c254e06 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:37.775467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932a04b-8946-45ac-8b65-dd558c254e06 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:37.793883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b128b2-fe62-4c1b-88ea-cd159eb0421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:37.794547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b128b2-fe62-4c1b-88ea-cd159eb0421c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.794826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b128b2-fe62-4c1b-88ea-cd159eb0421c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.795132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b128b2-fe62-4c1b-88ea-cd159eb0421c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:37.795889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b128b2-fe62-4c1b-88ea-cd159eb0421c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:37.798883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b128b2-fe62-4c1b-88ea-cd159eb0421c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:37.818213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1164/2331] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:37.819704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4282a-eb98-450c-8554-febf45c823e2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:37.837371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4282a-eb98-450c-8554-febf45c823e2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:37.845663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c67a04-492f-4dab-9cb8-b9722bc95f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:37.846863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c67a04-492f-4dab-9cb8-b9722bc95f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.847188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c67a04-492f-4dab-9cb8-b9722bc95f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.847469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c67a04-492f-4dab-9cb8-b9722bc95f99 admin admin] PATH_INFO: `/v3/projects/96b4962a91e7426cb04d63440844e5d6/users/ab92eea195664da885c26b5c99936c80/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:37.878693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c67a04-492f-4dab-9cb8-b9722bc95f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b4962a91e7426cb04d63440844e5d6, user_id=ab92eea195664da885c26b5c99936c80, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:37.880413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c67a04-492f-4dab-9cb8-b9722bc95f99 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:37.917040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:37.921704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1168/2332] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:37 2022] PUT /identity/v3/projects/96b4962a91e7426cb04d63440844e5d6/users/ab92eea195664da885c26b5c99936c80/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:37.937226 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467e21a-6485-4f61-8988-2719f3f70eb8 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:37.939173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467e21a-6485-4f61-8988-2719f3f70eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:37.939173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467e21a-6485-4f61-8988-2719f3f70eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:38.000691 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3467e21a-6485-4f61-8988-2719f3f70eb8 None None] MFA Rules not processed for user `ab92eea195664da885c26b5c99936c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:38.002364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3467e21a-6485-4f61-8988-2719f3f70eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:38.179319 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1165/2333] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:38.184221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c67a04-492f-4dab-9cb8-b9722bc95f99 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:38.349143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c67a04-492f-4dab-9cb8-b9722bc95f99 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:38.354704 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208865a-37e5-48b7-8fd7-a52f72b0166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:38.356278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208865a-37e5-48b7-8fd7-a52f72b0166e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:38.356821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208865a-37e5-48b7-8fd7-a52f72b0166e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:38.357302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208865a-37e5-48b7-8fd7-a52f72b0166e admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:38.358427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208865a-37e5-48b7-8fd7-a52f72b0166e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:38.361288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208865a-37e5-48b7-8fd7-a52f72b0166e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:38.407747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1169/2334] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:38 2022] POST /identity/v3/projects => generated 381 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:42:38.414618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467e21a-6485-4f61-8988-2719f3f70eb8 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:38.460144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467e21a-6485-4f61-8988-2719f3f70eb8 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:38.562233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:38.592646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b4b70-187a-4f3b-9b46-67db1cd6704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:38.593208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b4b70-187a-4f3b-9b46-67db1cd6704f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:38.593491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b4b70-187a-4f3b-9b46-67db1cd6704f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:38.593977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b4b70-187a-4f3b-9b46-67db1cd6704f admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:38.595335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b4b70-187a-4f3b-9b46-67db1cd6704f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:38.598269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b4b70-187a-4f3b-9b46-67db1cd6704f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:38.649982 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1166/2335] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:38 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:38.655280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208865a-37e5-48b7-8fd7-a52f72b0166e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:38.673304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208865a-37e5-48b7-8fd7-a52f72b0166e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:38.679083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88f2bc-3930-47ee-b954-098984681906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:38.680030 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f2bc-3930-47ee-b954-098984681906 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:38.680362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f2bc-3930-47ee-b954-098984681906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:38.680725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f2bc-3930-47ee-b954-098984681906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:38.681576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88f2bc-3930-47ee-b954-098984681906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:38.684137 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88f2bc-3930-47ee-b954-098984681906 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:38.728419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1170/2336] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:38.734630 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b4b70-187a-4f3b-9b46-67db1cd6704f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:38.748364 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b4b70-187a-4f3b-9b46-67db1cd6704f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:38.756730 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc929f-11c6-4c86-b1d6-80c62e7fd78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:38.757628 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc929f-11c6-4c86-b1d6-80c62e7fd78b admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:38.758085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc929f-11c6-4c86-b1d6-80c62e7fd78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:38.758544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc929f-11c6-4c86-b1d6-80c62e7fd78b admin admin] PATH_INFO: `/v3/projects/66289846763c49c4bf605eac273593ca/users/b38b828f9c444a04aff42eecd337882d/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:38.787101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc929f-11c6-4c86-b1d6-80c62e7fd78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66289846763c49c4bf605eac273593ca, user_id=b38b828f9c444a04aff42eecd337882d, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:38.790410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc929f-11c6-4c86-b1d6-80c62e7fd78b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:38.817424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1167/2337] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:38 2022] PUT /identity/v3/projects/66289846763c49c4bf605eac273593ca/users/b38b828f9c444a04aff42eecd337882d/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:38.823472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88f2bc-3930-47ee-b954-098984681906 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:38.837965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88f2bc-3930-47ee-b954-098984681906 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:38.923877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613c057-b940-4777-8892-ace84df44bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:38.924763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613c057-b940-4777-8892-ace84df44bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:38.925051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613c057-b940-4777-8892-ace84df44bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:38.925876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613c057-b940-4777-8892-ace84df44bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:38.926614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613c057-b940-4777-8892-ace84df44bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:38.928271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613c057-b940-4777-8892-ace84df44bd3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:38.946184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1171/2338] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:38.947230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc929f-11c6-4c86-b1d6-80c62e7fd78b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:38.970095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc929f-11c6-4c86-b1d6-80c62e7fd78b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:38.977308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0858ff3-a986-42f6-9d49-6ef79a429718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:38.977848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858ff3-a986-42f6-9d49-6ef79a429718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:38.978138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858ff3-a986-42f6-9d49-6ef79a429718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:38.978422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858ff3-a986-42f6-9d49-6ef79a429718 admin admin] PATH_INFO: `/v3/projects/66289846763c49c4bf605eac273593ca/users/b38b828f9c444a04aff42eecd337882d/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:38.983702 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0858ff3-a986-42f6-9d49-6ef79a429718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66289846763c49c4bf605eac273593ca, user_id=b38b828f9c444a04aff42eecd337882d, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:38.986589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0858ff3-a986-42f6-9d49-6ef79a429718 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:39.004667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1168/2339] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:38 2022] PUT /identity/v3/projects/66289846763c49c4bf605eac273593ca/users/b38b828f9c444a04aff42eecd337882d/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:42:39.015241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeec0c-88bb-4c32-9bcc-80b3d3e0a327 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:39.015531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeec0c-88bb-4c32-9bcc-80b3d3e0a327 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:39.015811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeec0c-88bb-4c32-9bcc-80b3d3e0a327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:39.092975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-81eeec0c-88bb-4c32-9bcc-80b3d3e0a327 None None] MFA Rules not processed for user `b38b828f9c444a04aff42eecd337882d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:39.095200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-81eeec0c-88bb-4c32-9bcc-80b3d3e0a327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:39.188455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:39.210448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1172/2340] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:39.223679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0858ff3-a986-42f6-9d49-6ef79a429718 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:39.226577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0858ff3-a986-42f6-9d49-6ef79a429718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:39.390873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0858ff3-a986-42f6-9d49-6ef79a429718 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:39.404806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50146f04-ca6d-4d78-a025-a551f3c7bb1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:39.405465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50146f04-ca6d-4d78-a025-a551f3c7bb1a service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:39.405747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50146f04-ca6d-4d78-a025-a551f3c7bb1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:39.406078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50146f04-ca6d-4d78-a025-a551f3c7bb1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:39.423016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50146f04-ca6d-4d78-a025-a551f3c7bb1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:39.423016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50146f04-ca6d-4d78-a025-a551f3c7bb1a service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:39.438148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1169/2341] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:39.571524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeec0c-88bb-4c32-9bcc-80b3d3e0a327 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:39.585855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeec0c-88bb-4c32-9bcc-80b3d3e0a327 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:39.591223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9133fa3-63d6-4a3d-b8f3-fac7eb84da55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:39.592041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133fa3-63d6-4a3d-b8f3-fac7eb84da55 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:39.592734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133fa3-63d6-4a3d-b8f3-fac7eb84da55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:39.593009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133fa3-63d6-4a3d-b8f3-fac7eb84da55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:39.678705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9133fa3-63d6-4a3d-b8f3-fac7eb84da55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:39.681236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9133fa3-63d6-4a3d-b8f3-fac7eb84da55 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:39.692122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1173/2342] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:40.215346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50146f04-ca6d-4d78-a025-a551f3c7bb1a service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:40.341967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50146f04-ca6d-4d78-a025-a551f3c7bb1a service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:40.347582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:40.348344 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:40.348687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:40.349025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] PATH_INFO: `/v3/users/ab92eea195664da885c26b5c99936c80` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:40.350299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab92eea195664da885c26b5c99936c80)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:40.353638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:40.453169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:40.465121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab92eea195664da885c26b5c99936c80'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:40.467567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab92eea195664da885c26b5c99936c80'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:40.485476 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab92eea195664da885c26b5c99936c80'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:40.505413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab92eea195664da885c26b5c99936c80'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:40.522913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab92eea195664da885c26b5c99936c80'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:40.531206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1170/2343] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:40 2022] DELETE /identity/v3/users/ab92eea195664da885c26b5c99936c80 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:40.536112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6c0d5-d0a5-4afb-ac4c-9499a55c524a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:40.536607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6c0d5-d0a5-4afb-ac4c-9499a55c524a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:40.536690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6c0d5-d0a5-4afb-ac4c-9499a55c524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:40.578493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-22c6c0d5-d0a5-4afb-ac4c-9499a55c524a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:40.582069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-22c6c0d5-d0a5-4afb-ac4c-9499a55c524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:40.732079 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1174/2344] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:40.790685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:40.792208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:40.848490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6c0d5-d0a5-4afb-ac4c-9499a55c524a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:40.852106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-22c6c0d5-d0a5-4afb-ac4c-9499a55c524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:40.940828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19604-675d-446b-9661-529e16b07074 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:40.949001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6020a61-552a-4e6a-ab2f-45a269a555ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:40.949646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6020a61-552a-4e6a-ab2f-45a269a555ba service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:40.952764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6020a61-552a-4e6a-ab2f-45a269a555ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:40.952764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6020a61-552a-4e6a-ab2f-45a269a555ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:40.968202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6020a61-552a-4e6a-ab2f-45a269a555ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:40.969812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6020a61-552a-4e6a-ab2f-45a269a555ba service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:40.981724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1171/2345] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:41.000000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6c0d5-d0a5-4afb-ac4c-9499a55c524a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:41.014716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742d3cd-7304-4945-b9c3-cacb96718326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:41.015347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d3cd-7304-4945-b9c3-cacb96718326 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:41.015714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d3cd-7304-4945-b9c3-cacb96718326 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:41.016076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d3cd-7304-4945-b9c3-cacb96718326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:41.018145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e742d3cd-7304-4945-b9c3-cacb96718326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:41.150886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:41.238521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742d3cd-7304-4945-b9c3-cacb96718326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:41.244926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742d3cd-7304-4945-b9c3-cacb96718326 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:41.274439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1175/2346] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:41.859526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6020a61-552a-4e6a-ab2f-45a269a555ba service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:41.861758 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e6020a61-552a-4e6a-ab2f-45a269a555ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:41.905407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6020a61-552a-4e6a-ab2f-45a269a555ba service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:41.951566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:41.952490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:41.953878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:41.956817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] PATH_INFO: `/v3/projects/96b4962a91e7426cb04d63440844e5d6` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:41.967582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b4962a91e7426cb04d63440844e5d6)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:41.970692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:42.137570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b4962a91e7426cb04d63440844e5d6', 'request_id': 'req-1a32a507-7b56-4540-981a-90da6721f465'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.151403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b4962a91e7426cb04d63440844e5d6', 'request_id': 'req-1a32a507-7b56-4540-981a-90da6721f465'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.177778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b4962a91e7426cb04d63440844e5d6', 'request_id': 'req-1a32a507-7b56-4540-981a-90da6721f465'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.195275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] The token cache is being invalidate because project 96b4962a91e7426cb04d63440844e5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:42.196722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.197467 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.199633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1172/2347] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:41 2022] DELETE /identity/v3/projects/96b4962a91e7426cb04d63440844e5d6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:42.204805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742d3cd-7304-4945-b9c3-cacb96718326 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:42.223968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742d3cd-7304-4945-b9c3-cacb96718326 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:42.402293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:42.403012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:42.403443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:42.403727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] PATH_INFO: `/v3/users/b38b828f9c444a04aff42eecd337882d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:42.405280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38b828f9c444a04aff42eecd337882d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:42.407595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:42.485393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38b828f9c444a04aff42eecd337882d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.486116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38b828f9c444a04aff42eecd337882d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.509380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38b828f9c444a04aff42eecd337882d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.525188 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38b828f9c444a04aff42eecd337882d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.525997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a799441b-4f82-4d4f-ac52-905fbc31827a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38b828f9c444a04aff42eecd337882d'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:42.558197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1176/2348] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:42 2022] DELETE /identity/v3/users/b38b828f9c444a04aff42eecd337882d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:43.412714 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:43.415602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:43.439451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32a507-7b56-4540-981a-90da6721f465 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:43.554955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:43.579132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:43.579945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:43.580321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:43.580727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] PATH_INFO: `/v3/projects/66289846763c49c4bf605eac273593ca` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:43.582081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=66289846763c49c4bf605eac273593ca)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:43.584268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:43.682080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66289846763c49c4bf605eac273593ca', 'request_id': 'req-8635bbe5-f81b-4317-9e40-b597a5573ede'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:43.698650 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66289846763c49c4bf605eac273593ca', 'request_id': 'req-8635bbe5-f81b-4317-9e40-b597a5573ede'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:43.714031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66289846763c49c4bf605eac273593ca', 'request_id': 'req-8635bbe5-f81b-4317-9e40-b597a5573ede'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:43.751786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] The token cache is being invalidate because project 66289846763c49c4bf605eac273593ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:43.752451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:43.753540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8635bbe5-f81b-4317-9e40-b597a5573ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:43.759798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1173/2349] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:43 2022] DELETE /identity/v3/projects/66289846763c49c4bf605eac273593ca => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:43.763112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06416bf4-c7c2-41e3-aa86-96013a0fa319 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:43.763773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06416bf4-c7c2-41e3-aa86-96013a0fa319 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:43.763911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06416bf4-c7c2-41e3-aa86-96013a0fa319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:43.806710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-06416bf4-c7c2-41e3-aa86-96013a0fa319 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:43.807889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-06416bf4-c7c2-41e3-aa86-96013a0fa319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:43.919192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1177/2350] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:42:43.928625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69cb34-f6c6-476d-853f-fdabe58e25ea None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:43.929071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69cb34-f6c6-476d-853f-fdabe58e25ea None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:43.929470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69cb34-f6c6-476d-853f-fdabe58e25ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:43.953889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3a69cb34-f6c6-476d-853f-fdabe58e25ea None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:43.955347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3a69cb34-f6c6-476d-853f-fdabe58e25ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:43.968984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1174/2351] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:43.970765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06416bf4-c7c2-41e3-aa86-96013a0fa319 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:43.976115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:43.990484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06416bf4-c7c2-41e3-aa86-96013a0fa319 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:44.006889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671b7c9-1551-46fa-91a0-afd826b25d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:44.007550 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671b7c9-1551-46fa-91a0-afd826b25d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:44.007825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671b7c9-1551-46fa-91a0-afd826b25d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:44.008091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671b7c9-1551-46fa-91a0-afd826b25d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:44.008792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671b7c9-1551-46fa-91a0-afd826b25d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:42:44.009093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671b7c9-1551-46fa-91a0-afd826b25d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:44.010688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671b7c9-1551-46fa-91a0-afd826b25d36 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:44.049320 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1178/2352] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:42:44.054760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69cb34-f6c6-476d-853f-fdabe58e25ea None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:44.069184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69cb34-f6c6-476d-853f-fdabe58e25ea None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:44.081441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970998a8-2ce4-4ca8-9b3a-bea11ae05dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:44.084435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970998a8-2ce4-4ca8-9b3a-bea11ae05dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:44.084435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970998a8-2ce4-4ca8-9b3a-bea11ae05dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:44.084697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970998a8-2ce4-4ca8-9b3a-bea11ae05dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:44.085333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970998a8-2ce4-4ca8-9b3a-bea11ae05dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:44.090647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970998a8-2ce4-4ca8-9b3a-bea11ae05dd6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:44.138397 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1175/2353] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:42:44 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:44.144346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671b7c9-1551-46fa-91a0-afd826b25d36 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:44.157953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671b7c9-1551-46fa-91a0-afd826b25d36 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:44.298110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6045a7-a644-4cc9-8818-805b8647560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:44.298868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6045a7-a644-4cc9-8818-805b8647560e admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:44.299278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6045a7-a644-4cc9-8818-805b8647560e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:44.299645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6045a7-a644-4cc9-8818-805b8647560e admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:44.300824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6045a7-a644-4cc9-8818-805b8647560e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:44.302733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6045a7-a644-4cc9-8818-805b8647560e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:44.342284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1179/2354] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:42:44 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:42:44.347915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970998a8-2ce4-4ca8-9b3a-bea11ae05dd6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:44.393759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970998a8-2ce4-4ca8-9b3a-bea11ae05dd6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:44.428006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7077357-c01c-4db3-bdec-9a01be0e3089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:44.432598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7077357-c01c-4db3-bdec-9a01be0e3089 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:44.433820 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7077357-c01c-4db3-bdec-9a01be0e3089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:44.434106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7077357-c01c-4db3-bdec-9a01be0e3089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:44.434862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7077357-c01c-4db3-bdec-9a01be0e3089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:44.436540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7077357-c01c-4db3-bdec-9a01be0e3089 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:44.477715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1176/2355] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:44.479953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6045a7-a644-4cc9-8818-805b8647560e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:44.504776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6045a7-a644-4cc9-8818-805b8647560e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:44.515556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616e044-7718-496c-9cce-d5adb2c0f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:44.517507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616e044-7718-496c-9cce-d5adb2c0f268 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:44.518010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616e044-7718-496c-9cce-d5adb2c0f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:44.518671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616e044-7718-496c-9cce-d5adb2c0f268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:44.520165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616e044-7718-496c-9cce-d5adb2c0f268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:44.523407 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616e044-7718-496c-9cce-d5adb2c0f268 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:44.545885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1180/2356] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:42:44.547159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7077357-c01c-4db3-bdec-9a01be0e3089 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:44.575282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7077357-c01c-4db3-bdec-9a01be0e3089 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:44.600952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d447a16-fe9d-49c6-8eb1-437498e45312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:44.604095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447a16-fe9d-49c6-8eb1-437498e45312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:44.604407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447a16-fe9d-49c6-8eb1-437498e45312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:44.604677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447a16-fe9d-49c6-8eb1-437498e45312 admin admin] PATH_INFO: `/v3/projects/52860c75abfe4a2296e91d068cdc5971/users/b0cec3a5d9b140e983e09942b6a1ceb9/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:44.665027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d447a16-fe9d-49c6-8eb1-437498e45312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52860c75abfe4a2296e91d068cdc5971, user_id=b0cec3a5d9b140e983e09942b6a1ceb9, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:44.668334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d447a16-fe9d-49c6-8eb1-437498e45312 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:44.695720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1177/2357] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:42:44 2022] PUT /identity/v3/projects/52860c75abfe4a2296e91d068cdc5971/users/b0cec3a5d9b140e983e09942b6a1ceb9/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:44.702914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5cfb-b576-41cb-9894-419625398a39 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:44.702914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5cfb-b576-41cb-9894-419625398a39 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:44.702914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5cfb-b576-41cb-9894-419625398a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:44.767834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-11ff5cfb-b576-41cb-9894-419625398a39 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:44.771630 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-11ff5cfb-b576-41cb-9894-419625398a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:44.928740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1181/2358] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:44.936258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d447a16-fe9d-49c6-8eb1-437498e45312 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:44.942463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9d447a16-fe9d-49c6-8eb1-437498e45312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:45.075110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d447a16-fe9d-49c6-8eb1-437498e45312 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:45.079846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b44dc-315a-4773-b433-b474bb79b951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:45.080520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b44dc-315a-4773-b433-b474bb79b951 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:45.080841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b44dc-315a-4773-b433-b474bb79b951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:45.081142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b44dc-315a-4773-b433-b474bb79b951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:45.091641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b44dc-315a-4773-b433-b474bb79b951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:45.093107 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b44dc-315a-4773-b433-b474bb79b951 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:45.110100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1178/2359] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:46.853187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b491ff-1afb-4d0b-a00a-92f39c02d074 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:46.854258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b491ff-1afb-4d0b-a00a-92f39c02d074 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:46.854882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b491ff-1afb-4d0b-a00a-92f39c02d074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:46.978176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-68b491ff-1afb-4d0b-a00a-92f39c02d074 None None] MFA Rules not processed for user `b0cec3a5d9b140e983e09942b6a1ceb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:46.978383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-68b491ff-1afb-4d0b-a00a-92f39c02d074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:47.069904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b44dc-315a-4773-b433-b474bb79b951 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:47.071450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b74b44dc-315a-4773-b433-b474bb79b951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:47.095604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b44dc-315a-4773-b433-b474bb79b951 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:47.111675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:47.112575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:47.113058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:47.113522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] PATH_INFO: `/v3/users/8073e820e4e8406a98962e6809a21730` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:47.115756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8073e820e4e8406a98962e6809a21730)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:47.127692 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:47.142181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:47.159884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:47.181046 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1182/2360] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:47.192868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b491ff-1afb-4d0b-a00a-92f39c02d074 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:47.199789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-68b491ff-1afb-4d0b-a00a-92f39c02d074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:47.259053 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8073e820e4e8406a98962e6809a21730'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:47.264224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8073e820e4e8406a98962e6809a21730'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:47.303379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8073e820e4e8406a98962e6809a21730'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:47.327156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8073e820e4e8406a98962e6809a21730'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:47.360007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c39d8dcf-195c-40c9-8f61-87a63548ec90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8073e820e4e8406a98962e6809a21730'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:47.382073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1179/2361] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:47 2022] DELETE /identity/v3/users/8073e820e4e8406a98962e6809a21730 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:47.391249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570900-aa84-4d3b-80f9-5cbb1b6976f4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:47.397775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b491ff-1afb-4d0b-a00a-92f39c02d074 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:47.398307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570900-aa84-4d3b-80f9-5cbb1b6976f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:47.398721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570900-aa84-4d3b-80f9-5cbb1b6976f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:47.469602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2f570900-aa84-4d3b-80f9-5cbb1b6976f4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:47.473001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2f570900-aa84-4d3b-80f9-5cbb1b6976f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:47.542724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:47.543691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:47.543971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:47.544337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:47.548223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:47.607143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1180/2362] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:47.618617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f570900-aa84-4d3b-80f9-5cbb1b6976f4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:47.623104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2f570900-aa84-4d3b-80f9-5cbb1b6976f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:47.716930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:47.719813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:47.738965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1183/2363] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:47.741400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f570900-aa84-4d3b-80f9-5cbb1b6976f4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:47.759644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddd011-0b65-4cbf-8698-38b964f7aa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:47.759644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddd011-0b65-4cbf-8698-38b964f7aa0b service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:47.759644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddd011-0b65-4cbf-8698-38b964f7aa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:47.759644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddd011-0b65-4cbf-8698-38b964f7aa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:47.777988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddd011-0b65-4cbf-8698-38b964f7aa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:47.782058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddd011-0b65-4cbf-8698-38b964f7aa0b service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:47.802869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1181/2364] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:48.431318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:48.434230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:48.459955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c531-e5fe-4e0b-a3b2-e830818c0a9d service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:48.480860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:48.481868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:48.482122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:48.482585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] PATH_INFO: `/v3/projects/8625f2e289234eca8ba3c74ee293d439` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:48.484976 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8625f2e289234eca8ba3c74ee293d439)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:48.486951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:48.556760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8625f2e289234eca8ba3c74ee293d439', 'request_id': 'req-1226de58-1251-40ea-b105-2640964a2a37'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:48.565051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8625f2e289234eca8ba3c74ee293d439', 'request_id': 'req-1226de58-1251-40ea-b105-2640964a2a37'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:48.570453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:48.575293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8625f2e289234eca8ba3c74ee293d439', 'request_id': 'req-1226de58-1251-40ea-b105-2640964a2a37'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:48.594392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] The token cache is being invalidate because project 8625f2e289234eca8ba3c74ee293d439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:42:48.594683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:48.595510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-1226de58-1251-40ea-b105-2640964a2a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:48.597072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1184/2365] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:42:48 2022] DELETE /identity/v3/projects/8625f2e289234eca8ba3c74ee293d439 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:42:49.429282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb746182-b2ff-4eb3-aa42-f9ab9b1a26e3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:49.429863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb746182-b2ff-4eb3-aa42-f9ab9b1a26e3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:49.429863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb746182-b2ff-4eb3-aa42-f9ab9b1a26e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:49.453973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-bb746182-b2ff-4eb3-aa42-f9ab9b1a26e3 None None] MFA Rules not processed for user `b0cec3a5d9b140e983e09942b6a1ceb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:49.455371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bb746182-b2ff-4eb3-aa42-f9ab9b1a26e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:49.482335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:49.532005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1182/2366] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:42:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:54.474543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d410c8-d92a-484c-84f5-a1a222b480c1 None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:54.475182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d410c8-d92a-484c-84f5-a1a222b480c1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:54.475182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d410c8-d92a-484c-84f5-a1a222b480c1 None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:54.476810 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1185/2367] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:42:54.484625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11266983-6d68-45ea-8f41-2440e527f959 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:54.485214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11266983-6d68-45ea-8f41-2440e527f959 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:54.485214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11266983-6d68-45ea-8f41-2440e527f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:54.510596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-11266983-6d68-45ea-8f41-2440e527f959 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:54.511892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-11266983-6d68-45ea-8f41-2440e527f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:54.588096 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1183/2368] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:42:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:54.601051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d410c8-d92a-484c-84f5-a1a222b480c1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:54.604627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f2d410c8-d92a-484c-84f5-a1a222b480c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:54.692793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d410c8-d92a-484c-84f5-a1a222b480c1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:54.701182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6d353-57ca-4555-b4e8-57e844caf654 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955c6cb8893c473fadd028b12bbea69d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:54.701805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6d353-57ca-4555-b4e8-57e844caf654 service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:54.702081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6d353-57ca-4555-b4e8-57e844caf654 service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:54.704265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6d353-57ca-4555-b4e8-57e844caf654 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:54.715767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6d353-57ca-4555-b4e8-57e844caf654 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:54.717193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6d353-57ca-4555-b4e8-57e844caf654 service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:54.729330 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1186/2369] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:54.810339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86c6a8-6401-4897-afcb-2f9374a95199 None None] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:54.810677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86c6a8-6401-4897-afcb-2f9374a95199 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:54.811008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86c6a8-6401-4897-afcb-2f9374a95199 None None] PATH_INFO: `/` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:54.812542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1184/2370] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:42:54.817733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857cb9-54b5-44b6-a0a4-dd6cd498b2b6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:54.818027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857cb9-54b5-44b6-a0a4-dd6cd498b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:54.818301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857cb9-54b5-44b6-a0a4-dd6cd498b2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:54.841503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e7857cb9-54b5-44b6-a0a4-dd6cd498b2b6 None None] MFA Rules not processed for user `c426cc367a1843d38978d3b8e636276e`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:54.843057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e7857cb9-54b5-44b6-a0a4-dd6cd498b2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:54.924074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1187/2371] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:42:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:54.945890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86c6a8-6401-4897-afcb-2f9374a95199 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:54.947439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1e86c6a8-6401-4897-afcb-2f9374a95199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:54.963657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86c6a8-6401-4897-afcb-2f9374a95199 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:54.967919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd47298-b79e-431b-ad91-4d0acb5848f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:54.969483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd47298-b79e-431b-ad91-4d0acb5848f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:54.969971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd47298-b79e-431b-ad91-4d0acb5848f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:54.970255 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd47298-b79e-431b-ad91-4d0acb5848f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:54.981792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd47298-b79e-431b-ad91-4d0acb5848f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:54.983829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd47298-b79e-431b-ad91-4d0acb5848f2 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:55.000428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1185/2372] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:42:55.107611 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aacd82-b24b-483e-b6e3-ad364553e54b None None] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:55.107898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aacd82-b24b-483e-b6e3-ad364553e54b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:55.108176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aacd82-b24b-483e-b6e3-ad364553e54b None None] PATH_INFO: `/` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:55.109587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1188/2373] 10.222.0.57 () {54 vars in 921 bytes} [Thu Aug 4 04:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 04:42:55.115201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06fb6b-c05d-491d-82e8-a61dd7434438 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:55.115491 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06fb6b-c05d-491d-82e8-a61dd7434438 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:55.115794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06fb6b-c05d-491d-82e8-a61dd7434438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:55.141494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-1b06fb6b-c05d-491d-82e8-a61dd7434438 None None] MFA Rules not processed for user `bd26e2ac2578438e854d51d8eed26463`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:55.142710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b06fb6b-c05d-491d-82e8-a61dd7434438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:55.152046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1186/2374] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Aug 4 04:42:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:42:55.167905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aacd82-b24b-483e-b6e3-ad364553e54b None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:55.169769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e5aacd82-b24b-483e-b6e3-ad364553e54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:55.203467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aacd82-b24b-483e-b6e3-ad364553e54b None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:55.207535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa644d9-b79c-4fa1-b85f-61ad1abbce10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:55.208181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa644d9-b79c-4fa1-b85f-61ad1abbce10 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:55.209038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa644d9-b79c-4fa1-b85f-61ad1abbce10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:55.209395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa644d9-b79c-4fa1-b85f-61ad1abbce10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:55.226147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa644d9-b79c-4fa1-b85f-61ad1abbce10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:55.227695 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa644d9-b79c-4fa1-b85f-61ad1abbce10 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:55.240617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1189/2375] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:42:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:42:59.681320 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06fb6b-c05d-491d-82e8-a61dd7434438 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:59.689290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-1b06fb6b-c05d-491d-82e8-a61dd7434438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:59.690555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d5140-4ed6-4a64-8bde-76515b769893 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:59.691006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d5140-4ed6-4a64-8bde-76515b769893 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:59.691132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d5140-4ed6-4a64-8bde-76515b769893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:59.721577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-318d5140-4ed6-4a64-8bde-76515b769893 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:42:59.723685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-318d5140-4ed6-4a64-8bde-76515b769893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:59.783415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06fb6b-c05d-491d-82e8-a61dd7434438 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:42:59.790065 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:42:59.791118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:42:59.791410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:42:59.791932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] PATH_INFO: `/v3/users/a51a44fbcfca4e509d82c48432b549d8` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:42:59.793417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51a44fbcfca4e509d82c48432b549d8)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:42:59.796332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:42:59.826267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1190/2376] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:42:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:42:59.860702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d5140-4ed6-4a64-8bde-76515b769893 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:42:59.862196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-318d5140-4ed6-4a64-8bde-76515b769893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:42:59.906457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51a44fbcfca4e509d82c48432b549d8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:59.906457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51a44fbcfca4e509d82c48432b549d8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:59.913746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:59.939535 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51a44fbcfca4e509d82c48432b549d8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:59.971671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:42:59.973659 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51a44fbcfca4e509d82c48432b549d8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:42:59.993871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8b6603d0-8963-47bb-816a-182b2c9ac33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51a44fbcfca4e509d82c48432b549d8'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:00.006103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1187/2377] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:42:59 2022] DELETE /identity/v3/users/a51a44fbcfca4e509d82c48432b549d8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:43:00.007679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57095-4c41-45ed-9b80-22d1639a6ef6 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:00.008940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57095-4c41-45ed-9b80-22d1639a6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:00.008940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57095-4c41-45ed-9b80-22d1639a6ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:00.042338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e7f57095-4c41-45ed-9b80-22d1639a6ef6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:00.043991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e7f57095-4c41-45ed-9b80-22d1639a6ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:00.057067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d5140-4ed6-4a64-8bde-76515b769893 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:00.135055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1188/2378] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:00.148625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57095-4c41-45ed-9b80-22d1639a6ef6 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:00.152375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e7f57095-4c41-45ed-9b80-22d1639a6ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:00.168788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:00.169572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:00.169947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:00.170299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:00.174388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:00.248636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57095-4c41-45ed-9b80-22d1639a6ef6 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:00.254426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6e9e8-f8f3-4032-b821-6530c0304c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:00.255199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:00.255339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6e9e8-f8f3-4032-b821-6530c0304c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:00.255636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6e9e8-f8f3-4032-b821-6530c0304c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:00.256029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6e9e8-f8f3-4032-b821-6530c0304c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:00.257266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:00.270449 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1191/2379] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:42:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 04:43:00.270797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6e9e8-f8f3-4032-b821-6530c0304c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:00.272322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6e9e8-f8f3-4032-b821-6530c0304c93 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:00.284335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1189/2380] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:00.843533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:00.845832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:00.869089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd6be-c6fe-4e97-aa5e-03b1c9dc3ab5 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:00.890640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:00.891372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:00.891659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:00.892462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] PATH_INFO: `/v3/projects/9c22a2c1cd0145778a041f3ca0f9ef7e` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:00.909666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c22a2c1cd0145778a041f3ca0f9ef7e)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:00.912064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:00.960324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe46801-eae5-4831-bafa-76c6b19b5935 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:00.960873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe46801-eae5-4831-bafa-76c6b19b5935 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:00.960873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe46801-eae5-4831-bafa-76c6b19b5935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:00.981805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8fe46801-eae5-4831-bafa-76c6b19b5935 None None] MFA Rules not processed for user `41e527395daf428ab00fd78c2412ed13`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:00.983008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8fe46801-eae5-4831-bafa-76c6b19b5935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:00.991409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c22a2c1cd0145778a041f3ca0f9ef7e', 'request_id': 'req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:00.998049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c22a2c1cd0145778a041f3ca0f9ef7e', 'request_id': 'req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:01.010256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c22a2c1cd0145778a041f3ca0f9ef7e', 'request_id': 'req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:01.043115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] The token cache is being invalidate because project 9c22a2c1cd0145778a041f3ca0f9ef7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:43:01.043528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:01.045178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c3f78c74-b64b-431b-9acb-f6dc09b9b2f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:01.048786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1192/2381] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:43:00 2022] DELETE /identity/v3/projects/9c22a2c1cd0145778a041f3ca0f9ef7e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:43:01.053714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd8fa-ff78-4e13-873c-624ec81610f1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:01.054081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd8fa-ff78-4e13-873c-624ec81610f1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:01.054419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd8fa-ff78-4e13-873c-624ec81610f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:01.064709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:01.075327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1190/2382] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:43:01.101086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9f0cd8fa-ff78-4e13-873c-624ec81610f1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:01.102615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9f0cd8fa-ff78-4e13-873c-624ec81610f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:01.224016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1193/2383] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:43:01.232436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4a1f4-9414-41ba-9488-9a26f7ad6257 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:01.233075 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4a1f4-9414-41ba-9488-9a26f7ad6257 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:01.233502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4a1f4-9414-41ba-9488-9a26f7ad6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:01.280361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-30a4a1f4-9414-41ba-9488-9a26f7ad6257 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:01.281550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-30a4a1f4-9414-41ba-9488-9a26f7ad6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:01.313698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1191/2384] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:01.318826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd8fa-ff78-4e13-873c-624ec81610f1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:01.346202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd8fa-ff78-4e13-873c-624ec81610f1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:01.355853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9f987-3d1a-4146-bfdc-bab3f4e16605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:01.356930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9f987-3d1a-4146-bfdc-bab3f4e16605 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:01.359783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9f987-3d1a-4146-bfdc-bab3f4e16605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:01.360344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9f987-3d1a-4146-bfdc-bab3f4e16605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:01.361288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9f987-3d1a-4146-bfdc-bab3f4e16605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:43:01.363170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9f987-3d1a-4146-bfdc-bab3f4e16605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:01.365181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9f987-3d1a-4146-bfdc-bab3f4e16605 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:01.393288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1194/2385] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:43:01.398474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4a1f4-9414-41ba-9488-9a26f7ad6257 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:01.412817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4a1f4-9414-41ba-9488-9a26f7ad6257 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:01.419675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387ddc9-3095-4e73-8031-66090be2d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:01.420639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ddc9-3095-4e73-8031-66090be2d8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:01.421210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ddc9-3095-4e73-8031-66090be2d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:01.422689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ddc9-3095-4e73-8031-66090be2d8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:01.423573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387ddc9-3095-4e73-8031-66090be2d8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:01.427670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387ddc9-3095-4e73-8031-66090be2d8d5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:01.448686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:01.493178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1192/2386] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:43:01 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:43:01.497707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9f987-3d1a-4146-bfdc-bab3f4e16605 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:01.518110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9f987-3d1a-4146-bfdc-bab3f4e16605 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:01.635116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2195b6f-81e9-4e35-be80-29c976b1e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:01.636096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2195b6f-81e9-4e35-be80-29c976b1e0bc admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:01.636635 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2195b6f-81e9-4e35-be80-29c976b1e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:01.637004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2195b6f-81e9-4e35-be80-29c976b1e0bc admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:01.637952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2195b6f-81e9-4e35-be80-29c976b1e0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:01.640710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2195b6f-81e9-4e35-be80-29c976b1e0bc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:01.685099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1195/2387] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:43:01 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:43:01.689736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387ddc9-3095-4e73-8031-66090be2d8d5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:01.705522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387ddc9-3095-4e73-8031-66090be2d8d5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:01.727047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573f1bf-abe2-4995-afa6-fb8e1051b739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:01.727942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573f1bf-abe2-4995-afa6-fb8e1051b739 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:01.728443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573f1bf-abe2-4995-afa6-fb8e1051b739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:01.728924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573f1bf-abe2-4995-afa6-fb8e1051b739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:01.729877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573f1bf-abe2-4995-afa6-fb8e1051b739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:01.739069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573f1bf-abe2-4995-afa6-fb8e1051b739 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:01.750676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1193/2388] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:43:01.755047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2195b6f-81e9-4e35-be80-29c976b1e0bc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:01.805464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2195b6f-81e9-4e35-be80-29c976b1e0bc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:01.824091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3765-4a9c-4965-b2c8-025f409c205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:01.824565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3765-4a9c-4965-b2c8-025f409c205d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:01.824918 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3765-4a9c-4965-b2c8-025f409c205d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:01.825402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3765-4a9c-4965-b2c8-025f409c205d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:01.826311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3765-4a9c-4965-b2c8-025f409c205d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:01.830860 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f3765-4a9c-4965-b2c8-025f409c205d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:01.862787 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1196/2389] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:43:01.864516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573f1bf-abe2-4995-afa6-fb8e1051b739 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:01.881833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573f1bf-abe2-4995-afa6-fb8e1051b739 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:01.887335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494ee7-ba4c-4971-8a49-542e395a3239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:01.888387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494ee7-ba4c-4971-8a49-542e395a3239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:01.888744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494ee7-ba4c-4971-8a49-542e395a3239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:01.889090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494ee7-ba4c-4971-8a49-542e395a3239 admin admin] PATH_INFO: `/v3/projects/0e0ab14edae94879b79723761ecd59af/users/c60d3c43ad0c44fda5683210685dc2c5/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:01.910405 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e494ee7-ba4c-4971-8a49-542e395a3239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0ab14edae94879b79723761ecd59af, user_id=c60d3c43ad0c44fda5683210685dc2c5, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:01.914948 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e494ee7-ba4c-4971-8a49-542e395a3239 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:01.937389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1194/2390] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:43:01 2022] PUT /identity/v3/projects/0e0ab14edae94879b79723761ecd59af/users/c60d3c43ad0c44fda5683210685dc2c5/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:43:01.948422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831f45d-4448-4de8-a759-0bf53f598791 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:01.948801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831f45d-4448-4de8-a759-0bf53f598791 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:01.950923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831f45d-4448-4de8-a759-0bf53f598791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:02.005955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e831f45d-4448-4de8-a759-0bf53f598791 None None] MFA Rules not processed for user `c60d3c43ad0c44fda5683210685dc2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:02.007451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e831f45d-4448-4de8-a759-0bf53f598791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:02.123394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:02.154406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1197/2391] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:43:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:02.176402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494ee7-ba4c-4971-8a49-542e395a3239 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:02.178126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7e494ee7-ba4c-4971-8a49-542e395a3239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:02.306093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494ee7-ba4c-4971-8a49-542e395a3239 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:02.313498 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a2863-e08e-4613-bf8d-66ece3d8c387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:02.314143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a2863-e08e-4613-bf8d-66ece3d8c387 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:02.314424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a2863-e08e-4613-bf8d-66ece3d8c387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:02.314700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a2863-e08e-4613-bf8d-66ece3d8c387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:02.336957 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a2863-e08e-4613-bf8d-66ece3d8c387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:02.337186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a2863-e08e-4613-bf8d-66ece3d8c387 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:02.348816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1195/2392] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:07.621535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831f45d-4448-4de8-a759-0bf53f598791 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:07.702624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831f45d-4448-4de8-a759-0bf53f598791 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:07.707529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:07.708258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:07.708586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:07.708857 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] PATH_INFO: `/v3/users/c60d3c43ad0c44fda5683210685dc2c5` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:07.710074 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60d3c43ad0c44fda5683210685dc2c5)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:07.712040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:07.789978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60d3c43ad0c44fda5683210685dc2c5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:07.791308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60d3c43ad0c44fda5683210685dc2c5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:07.815628 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60d3c43ad0c44fda5683210685dc2c5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:07.829954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60d3c43ad0c44fda5683210685dc2c5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:07.831058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60d3c43ad0c44fda5683210685dc2c5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:07.871036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1198/2393] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:43:07 2022] DELETE /identity/v3/users/c60d3c43ad0c44fda5683210685dc2c5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:43:07.872911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb6cf-6e44-4aa8-9386-e80887372c22 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:07.873427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb6cf-6e44-4aa8-9386-e80887372c22 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:07.873652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bb6cf-6e44-4aa8-9386-e80887372c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:07.916171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ef0bb6cf-6e44-4aa8-9386-e80887372c22 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:07.919878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ef0bb6cf-6e44-4aa8-9386-e80887372c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:08.015314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1196/2394] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:08.026889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:08.028426 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:08.090395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439de4-b583-4526-8346-8fbd0d37b588 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:08.094307 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c1bea-4b60-4a08-8faf-3a8af1051705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:08.095050 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c1bea-4b60-4a08-8faf-3a8af1051705 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:08.095392 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c1bea-4b60-4a08-8faf-3a8af1051705 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:08.095814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c1bea-4b60-4a08-8faf-3a8af1051705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:08.109245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c1bea-4b60-4a08-8faf-3a8af1051705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:08.110636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c1bea-4b60-4a08-8faf-3a8af1051705 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:08.122713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1199/2395] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:08.535309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb6cf-6e44-4aa8-9386-e80887372c22 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:08.538709 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ef0bb6cf-6e44-4aa8-9386-e80887372c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:08.551917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bb6cf-6e44-4aa8-9386-e80887372c22 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:08.557951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:08.558660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:08.558940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:08.559238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] PATH_INFO: `/v3/projects/0e0ab14edae94879b79723761ecd59af` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:08.567561 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0ab14edae94879b79723761ecd59af)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:08.571173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:08.628565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:08.630509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0ab14edae94879b79723761ecd59af', 'request_id': 'req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:08.641171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0ab14edae94879b79723761ecd59af', 'request_id': 'req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:08.654631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0ab14edae94879b79723761ecd59af', 'request_id': 'req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:08.669844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] The token cache is being invalidate because project 0e0ab14edae94879b79723761ecd59af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:43:08.670206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:08.670902 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:43:08.672644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1197/2396] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:43:08 2022] DELETE /identity/v3/projects/0e0ab14edae94879b79723761ecd59af => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:43:18.004212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930e14d-353f-4c4f-ad9b-3fc3806d213d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:18.004845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930e14d-353f-4c4f-ad9b-3fc3806d213d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:18.004845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930e14d-353f-4c4f-ad9b-3fc3806d213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:18.025467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b930e14d-353f-4c4f-ad9b-3fc3806d213d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:18.026598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b930e14d-353f-4c4f-ad9b-3fc3806d213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:18.040841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:18.093844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1200/2397] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:18.110008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:18.111560 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:18.187940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647618-8be4-48fe-8b21-7d5f6d3b39a5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:18.193553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d6e32-1db8-4670-a201-6c3166e76e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:18.194185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d6e32-1db8-4670-a201-6c3166e76e8d service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:18.194470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d6e32-1db8-4670-a201-6c3166e76e8d service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:18.194745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d6e32-1db8-4670-a201-6c3166e76e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:18.204666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d6e32-1db8-4670-a201-6c3166e76e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:18.206261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d6e32-1db8-4670-a201-6c3166e76e8d service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:18.216604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1198/2398] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:21.959019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d042d53-b565-4b08-8d49-6529757486e0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:21.959543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d042d53-b565-4b08-8d49-6529757486e0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:21.959661 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d042d53-b565-4b08-8d49-6529757486e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:21.979729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8d042d53-b565-4b08-8d49-6529757486e0 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:21.980927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8d042d53-b565-4b08-8d49-6529757486e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:22.039278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1201/2399] 10.222.0.57 () {58 vars in 967 bytes} [Thu Aug 4 04:43:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:22.063821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d6e32-1db8-4670-a201-6c3166e76e8d service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:22.065420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-724d6e32-1db8-4670-a201-6c3166e76e8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:22.090841 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a1cb1-3a69-4d2a-bded-87f0b45ed11f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:22.091464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a1cb1-3a69-4d2a-bded-87f0b45ed11f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:22.091972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a1cb1-3a69-4d2a-bded-87f0b45ed11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:22.121363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a70a1cb1-3a69-4d2a-bded-87f0b45ed11f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:22.122976 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a70a1cb1-3a69-4d2a-bded-87f0b45ed11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:22.137557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1202/2400] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:22.167869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d6e32-1db8-4670-a201-6c3166e76e8d service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:22.176266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91f96a-d1fb-4bc3-b550-e06258536247 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:22.176899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91f96a-d1fb-4bc3-b550-e06258536247 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:22.177181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91f96a-d1fb-4bc3-b550-e06258536247 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:22.177543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91f96a-d1fb-4bc3-b550-e06258536247 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:22.187486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91f96a-d1fb-4bc3-b550-e06258536247 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:22.189092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91f96a-d1fb-4bc3-b550-e06258536247 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:22.197995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1199/2401] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:43:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:22.300758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a1cb1-3a69-4d2a-bded-87f0b45ed11f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:22.317803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a1cb1-3a69-4d2a-bded-87f0b45ed11f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:22.324255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0541c3-acde-445e-89e0-37714b2330ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:22.325027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0541c3-acde-445e-89e0-37714b2330ca service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:22.325313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0541c3-acde-445e-89e0-37714b2330ca service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:22.325588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0541c3-acde-445e-89e0-37714b2330ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:22.335031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0541c3-acde-445e-89e0-37714b2330ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:22.336642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0541c3-acde-445e-89e0-37714b2330ca service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:22.347241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1203/2402] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:25.169206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac57189-27a5-408f-8127-da1732901d67 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:25.169728 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac57189-27a5-408f-8127-da1732901d67 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:25.169860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac57189-27a5-408f-8127-da1732901d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:25.189801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cac57189-27a5-408f-8127-da1732901d67 None None] MFA Rules not processed for user `b0cec3a5d9b140e983e09942b6a1ceb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:25.191082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cac57189-27a5-408f-8127-da1732901d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:25.239219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:25.255775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1200/2403] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:26.461754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f293d8c-d167-4c92-abba-4095763131cb None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:26.462333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f293d8c-d167-4c92-abba-4095763131cb None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:26.462333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f293d8c-d167-4c92-abba-4095763131cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:26.489737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4f293d8c-d167-4c92-abba-4095763131cb None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:26.490957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4f293d8c-d167-4c92-abba-4095763131cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:26.499910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1204/2404] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:26.519613 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac57189-27a5-408f-8127-da1732901d67 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:26.521165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cac57189-27a5-408f-8127-da1732901d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:26.537547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac57189-27a5-408f-8127-da1732901d67 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:26.543738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ae77-a455-41fc-bb78-7d8ac7929d8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:26.544371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ae77-a455-41fc-bb78-7d8ac7929d8e service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:26.544675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ae77-a455-41fc-bb78-7d8ac7929d8e service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:26.544954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ae77-a455-41fc-bb78-7d8ac7929d8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:26.554724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ae77-a455-41fc-bb78-7d8ac7929d8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:26.556369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ae77-a455-41fc-bb78-7d8ac7929d8e service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:26.567425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1201/2405] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:30.421742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f293d8c-d167-4c92-abba-4095763131cb None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:30.424764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4f293d8c-d167-4c92-abba-4095763131cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:30.603059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f293d8c-d167-4c92-abba-4095763131cb None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:30.621017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29133627-5afe-4b9b-877a-8ecf88b9bb00 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:30.622025 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1741-d35f-4c87-9b48-bd357f72e192 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:30.622376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29133627-5afe-4b9b-877a-8ecf88b9bb00 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:30.622833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29133627-5afe-4b9b-877a-8ecf88b9bb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:30.624539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1741-d35f-4c87-9b48-bd357f72e192 service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:30.626640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1741-d35f-4c87-9b48-bd357f72e192 service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:30.627178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1741-d35f-4c87-9b48-bd357f72e192 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:30.629507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-55cc1741-d35f-4c87-9b48-bd357f72e192 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:30.675244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-29133627-5afe-4b9b-877a-8ecf88b9bb00 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:30.676601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-29133627-5afe-4b9b-877a-8ecf88b9bb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:30.691620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc1741-d35f-4c87-9b48-bd357f72e192 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:30.693878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc1741-d35f-4c87-9b48-bd357f72e192 service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:30.695251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1202/2406] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:43:30.714346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1205/2407] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:30.715394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29133627-5afe-4b9b-877a-8ecf88b9bb00 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:30.730051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29133627-5afe-4b9b-877a-8ecf88b9bb00 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:30.741966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775cadf-7c50-43d6-9ab8-3db9333079f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:30.743682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775cadf-7c50-43d6-9ab8-3db9333079f9 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:30.744458 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775cadf-7c50-43d6-9ab8-3db9333079f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:30.744745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775cadf-7c50-43d6-9ab8-3db9333079f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:30.754772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775cadf-7c50-43d6-9ab8-3db9333079f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:30.756429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775cadf-7c50-43d6-9ab8-3db9333079f9 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:30.767745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1203/2408] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:34.839323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a8dfc-f14c-4540-a86a-b2479bd8d55c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:34.839920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a8dfc-f14c-4540-a86a-b2479bd8d55c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:34.840202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a8dfc-f14c-4540-a86a-b2479bd8d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:34.862129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9f9a8dfc-f14c-4540-a86a-b2479bd8d55c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:34.862652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9f9a8dfc-f14c-4540-a86a-b2479bd8d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:34.871445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1206/2409] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:34.892134 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775cadf-7c50-43d6-9ab8-3db9333079f9 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:34.906033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775cadf-7c50-43d6-9ab8-3db9333079f9 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:34.913148 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139950ff-a4e2-4bdd-89d9-7dcae4c13863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:34.913350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139950ff-a4e2-4bdd-89d9-7dcae4c13863 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:34.915420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139950ff-a4e2-4bdd-89d9-7dcae4c13863 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:34.915420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139950ff-a4e2-4bdd-89d9-7dcae4c13863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:34.925085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139950ff-a4e2-4bdd-89d9-7dcae4c13863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:34.926809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139950ff-a4e2-4bdd-89d9-7dcae4c13863 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:34.940485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1204/2410] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:39.056756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eae97-65ae-4b9d-bc7e-9f71a9bf9cb0 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:39.057305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eae97-65ae-4b9d-bc7e-9f71a9bf9cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:39.057305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eae97-65ae-4b9d-bc7e-9f71a9bf9cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:39.077850 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8b3eae97-65ae-4b9d-bc7e-9f71a9bf9cb0 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:39.079070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8b3eae97-65ae-4b9d-bc7e-9f71a9bf9cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:39.086927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1207/2411] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:39.102520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139950ff-a4e2-4bdd-89d9-7dcae4c13863 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:39.114636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139950ff-a4e2-4bdd-89d9-7dcae4c13863 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:39.122178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a5086-0ef7-45af-ab84-22197a51c3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:39.123252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a5086-0ef7-45af-ab84-22197a51c3b3 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:39.123747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a5086-0ef7-45af-ab84-22197a51c3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:39.124220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a5086-0ef7-45af-ab84-22197a51c3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:39.135069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a5086-0ef7-45af-ab84-22197a51c3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:39.136916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a5086-0ef7-45af-ab84-22197a51c3b3 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:39.147684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1205/2412] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:43:49.072122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=93 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:49.150813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=29 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:43:54.183045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df889d-a002-47c8-a5a1-d229b9826583 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:54.183553 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df889d-a002-47c8-a5a1-d229b9826583 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:54.183665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df889d-a002-47c8-a5a1-d229b9826583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:54.203726 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-33df889d-a002-47c8-a5a1-d229b9826583 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:54.205000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-33df889d-a002-47c8-a5a1-d229b9826583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:54.212560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1208/2413] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:43:54.226913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a5086-0ef7-45af-ab84-22197a51c3b3 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:43:54.238815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a5086-0ef7-45af-ab84-22197a51c3b3 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:43:54.244035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bfa09-782f-4863-93af-85cf008aa300 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:43:54.244685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bfa09-782f-4863-93af-85cf008aa300 service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:54.244965 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bfa09-782f-4863-93af-85cf008aa300 service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:54.245236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bfa09-782f-4863-93af-85cf008aa300 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:54.257490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bfa09-782f-4863-93af-85cf008aa300 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:43:54.259111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bfa09-782f-4863-93af-85cf008aa300 service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:43:54.267871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1206/2414] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:43:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:43:57.796607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9f681-f85f-4806-9f88-f2fbb4738a4d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:43:57.797463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9f681-f85f-4806-9f88-f2fbb4738a4d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:43:57.797898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9f681-f85f-4806-9f88-f2fbb4738a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:43:57.825839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6fc9f681-f85f-4806-9f88-f2fbb4738a4d None None] MFA Rules not processed for user `6edff1bb210b4bf882b83feb2644dfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:43:57.827351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6fc9f681-f85f-4806-9f88-f2fbb4738a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:43:57.903478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1209/2415] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:43:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:04.264349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:07.893773 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=28 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:09.919721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414b54-50f3-4187-b9a8-ac842ac1901d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:09.920586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414b54-50f3-4187-b9a8-ac842ac1901d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:09.920868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9414b54-50f3-4187-b9a8-ac842ac1901d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:09.942486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f9414b54-50f3-4187-b9a8-ac842ac1901d None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:09.943770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f9414b54-50f3-4187-b9a8-ac842ac1901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:09.952261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1207/2416] 10.222.0.57 () {58 vars in 967 bytes} [Thu Aug 4 04:44:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:09.970391 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9f681-f85f-4806-9f88-f2fbb4738a4d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:09.983166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9f681-f85f-4806-9f88-f2fbb4738a4d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:09.988302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6aa85-0373-47eb-95df-1b4c8802d2ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:09.988932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6aa85-0373-47eb-95df-1b4c8802d2ab service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:09.989210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6aa85-0373-47eb-95df-1b4c8802d2ab service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:09.989477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6aa85-0373-47eb-95df-1b4c8802d2ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:09.998758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6aa85-0373-47eb-95df-1b4c8802d2ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:10.000399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6aa85-0373-47eb-95df-1b4c8802d2ab service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:10.008956 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1210/2417] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:44:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:44:12.269034 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9414b54-50f3-4187-b9a8-ac842ac1901d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:12.271604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f9414b54-50f3-4187-b9a8-ac842ac1901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:12.295564 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9414b54-50f3-4187-b9a8-ac842ac1901d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:12.300718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:12.301904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:12.302380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:12.302810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] PATH_INFO: `/v3/users/b0cec3a5d9b140e983e09942b6a1ceb9` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:12.305253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0cec3a5d9b140e983e09942b6a1ceb9)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:12.309078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:12.394600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0cec3a5d9b140e983e09942b6a1ceb9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.395618 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0cec3a5d9b140e983e09942b6a1ceb9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.418557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0cec3a5d9b140e983e09942b6a1ceb9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.429656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0cec3a5d9b140e983e09942b6a1ceb9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.444613 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-bb919678-4e11-4279-8895-be2c6a066a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0cec3a5d9b140e983e09942b6a1ceb9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.452267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1208/2418] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:44:12 2022] DELETE /identity/v3/users/b0cec3a5d9b140e983e09942b6a1ceb9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:44:12.723864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6aa85-0373-47eb-95df-1b4c8802d2ab service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:12.750373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6aa85-0373-47eb-95df-1b4c8802d2ab service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:12.833803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:12.834515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:12.834849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:12.835165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] PATH_INFO: `/v3/projects/52860c75abfe4a2296e91d068cdc5971` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:12.836347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52860c75abfe4a2296e91d068cdc5971)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:12.838422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:12.902474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52860c75abfe4a2296e91d068cdc5971', 'request_id': 'req-a6bb1218-c8ce-4147-90d5-1d652a3e258b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.909514 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52860c75abfe4a2296e91d068cdc5971', 'request_id': 'req-a6bb1218-c8ce-4147-90d5-1d652a3e258b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.921271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52860c75abfe4a2296e91d068cdc5971', 'request_id': 'req-a6bb1218-c8ce-4147-90d5-1d652a3e258b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.936767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] The token cache is being invalidate because project 52860c75abfe4a2296e91d068cdc5971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:44:12.937072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.937814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-a6bb1218-c8ce-4147-90d5-1d652a3e258b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:12.939427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1211/2419] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:44:12 2022] DELETE /identity/v3/projects/52860c75abfe4a2296e91d068cdc5971 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:44:12.944325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d9971-399e-466e-8bc0-e48ac5a8793f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:12.944606 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d9971-399e-466e-8bc0-e48ac5a8793f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:12.945074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d9971-399e-466e-8bc0-e48ac5a8793f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:12.968218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-975d9971-399e-466e-8bc0-e48ac5a8793f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:12.968934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-975d9971-399e-466e-8bc0-e48ac5a8793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:13.054896 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1209/2420] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:13.064081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d692c0-e0bc-46e1-9848-2742f70dd8af None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:13.064468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d692c0-e0bc-46e1-9848-2742f70dd8af None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:13.064665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d692c0-e0bc-46e1-9848-2742f70dd8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:13.091107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-e7d692c0-e0bc-46e1-9848-2742f70dd8af None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:13.092387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e7d692c0-e0bc-46e1-9848-2742f70dd8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:13.101263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1212/2421] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:13.108710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d9971-399e-466e-8bc0-e48ac5a8793f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:13.123088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d9971-399e-466e-8bc0-e48ac5a8793f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:13.129613 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ca803-fa52-4820-becb-5bba2d9b418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:13.130258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ca803-fa52-4820-becb-5bba2d9b418f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:13.130543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ca803-fa52-4820-becb-5bba2d9b418f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:13.130809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ca803-fa52-4820-becb-5bba2d9b418f admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:13.131735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ca803-fa52-4820-becb-5bba2d9b418f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:44:13.132046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ca803-fa52-4820-becb-5bba2d9b418f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:13.133697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ca803-fa52-4820-becb-5bba2d9b418f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:13.148422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1210/2422] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:44:13.152432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d692c0-e0bc-46e1-9848-2742f70dd8af None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:13.167427 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d692c0-e0bc-46e1-9848-2742f70dd8af None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:13.172913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde26179-c5da-40d3-9953-52fbb36a4f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:13.173899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde26179-c5da-40d3-9953-52fbb36a4f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:13.174387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde26179-c5da-40d3-9953-52fbb36a4f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:13.174870 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde26179-c5da-40d3-9953-52fbb36a4f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:13.176171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde26179-c5da-40d3-9953-52fbb36a4f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:13.178183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde26179-c5da-40d3-9953-52fbb36a4f2b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:13.214378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1213/2423] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:44:13 2022] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:44:13.218716 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ca803-fa52-4820-becb-5bba2d9b418f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:13.232718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ca803-fa52-4820-becb-5bba2d9b418f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:13.293414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:13.303652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5da1-bcab-4bb9-898b-3cd55c4bb92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:13.304583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5da1-bcab-4bb9-898b-3cd55c4bb92e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:13.305133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5da1-bcab-4bb9-898b-3cd55c4bb92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:13.305580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af5da1-bcab-4bb9-898b-3cd55c4bb92e admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:13.306686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af5da1-bcab-4bb9-898b-3cd55c4bb92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:13.308819 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af5da1-bcab-4bb9-898b-3cd55c4bb92e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:13.334434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1211/2424] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:44:13 2022] POST /identity/v3/users => generated 282 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:44:13.338813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde26179-c5da-40d3-9953-52fbb36a4f2b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:13.351617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde26179-c5da-40d3-9953-52fbb36a4f2b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:13.356614 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f147-79b5-4337-81ea-d3a4ebd965fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:13.357343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f147-79b5-4337-81ea-d3a4ebd965fb admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:13.359100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f147-79b5-4337-81ea-d3a4ebd965fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:13.359100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f147-79b5-4337-81ea-d3a4ebd965fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:13.359100 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2f147-79b5-4337-81ea-d3a4ebd965fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:13.360477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2f147-79b5-4337-81ea-d3a4ebd965fb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:13.376354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1214/2425] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:44:13.378510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5da1-bcab-4bb9-898b-3cd55c4bb92e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:13.390164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af5da1-bcab-4bb9-898b-3cd55c4bb92e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:13.396485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ccc07-e761-4b92-b272-874647eb85e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:13.397118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ccc07-e761-4b92-b272-874647eb85e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:13.397399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ccc07-e761-4b92-b272-874647eb85e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:13.397672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ccc07-e761-4b92-b272-874647eb85e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:13.398373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ccc07-e761-4b92-b272-874647eb85e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:13.400000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ccc07-e761-4b92-b272-874647eb85e6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:13.415376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1212/2426] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:44:13.417580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f147-79b5-4337-81ea-d3a4ebd965fb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:13.430147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f147-79b5-4337-81ea-d3a4ebd965fb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:13.439733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f1fa-76c7-4eee-9174-7fd4cd3a0bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:13.440488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f1fa-76c7-4eee-9174-7fd4cd3a0bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:13.440755 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f1fa-76c7-4eee-9174-7fd4cd3a0bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:13.441023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f1fa-76c7-4eee-9174-7fd4cd3a0bd6 admin admin] PATH_INFO: `/v3/projects/09ea270f3df94a6598daaa9e6e958040/users/1b4de8d8d0c54e99b84a07b3fd8a8aab/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:13.459506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218f1fa-76c7-4eee-9174-7fd4cd3a0bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ea270f3df94a6598daaa9e6e958040, user_id=1b4de8d8d0c54e99b84a07b3fd8a8aab, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:13.462452 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218f1fa-76c7-4eee-9174-7fd4cd3a0bd6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:13.479710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1215/2427] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:44:13 2022] PUT /identity/v3/projects/09ea270f3df94a6598daaa9e6e958040/users/1b4de8d8d0c54e99b84a07b3fd8a8aab/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:44:13.490243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425a3ce-cc4a-4626-aaf5-db1230aedfa4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:13.490724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425a3ce-cc4a-4626-aaf5-db1230aedfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:13.490828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425a3ce-cc4a-4626-aaf5-db1230aedfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:13.538301 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0425a3ce-cc4a-4626-aaf5-db1230aedfa4 None None] MFA Rules not processed for user `1b4de8d8d0c54e99b84a07b3fd8a8aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:13.539598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0425a3ce-cc4a-4626-aaf5-db1230aedfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:13.619541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1213/2428] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:44:13.631060 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f1fa-76c7-4eee-9174-7fd4cd3a0bd6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:13.632744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5218f1fa-76c7-4eee-9174-7fd4cd3a0bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:13.649155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:13.719147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f1fa-76c7-4eee-9174-7fd4cd3a0bd6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:13.723277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf1dff-053f-4f59-99ae-3ac940b907fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:13.723911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf1dff-053f-4f59-99ae-3ac940b907fe service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:13.724822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf1dff-053f-4f59-99ae-3ac940b907fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:13.725242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf1dff-053f-4f59-99ae-3ac940b907fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:13.741210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf1dff-053f-4f59-99ae-3ac940b907fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:13.745313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf1dff-053f-4f59-99ae-3ac940b907fe service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:13.761889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1216/2429] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:44:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:44:14.864961 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b85dc-c472-47b6-b5c7-457657939d43 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:14.865806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b85dc-c472-47b6-b5c7-457657939d43 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:14.866046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b85dc-c472-47b6-b5c7-457657939d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:14.890964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-191b85dc-c472-47b6-b5c7-457657939d43 None None] MFA Rules not processed for user `d6a6f20d09bc4d5abc7c2a7fc02376b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:14.892194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-191b85dc-c472-47b6-b5c7-457657939d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:14.977193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1214/2430] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:44:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:15.147616 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddf99-c565-46f4-a15c-950f931f9b6b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:15.148186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddf99-c565-46f4-a15c-950f931f9b6b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:15.148186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddf99-c565-46f4-a15c-950f931f9b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:15.177377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-8c2ddf99-c565-46f4-a15c-950f931f9b6b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:15.178637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c2ddf99-c565-46f4-a15c-950f931f9b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:15.268440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1217/2431] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:15.289513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b85dc-c472-47b6-b5c7-457657939d43 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:15.291668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-191b85dc-c472-47b6-b5c7-457657939d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:15.398722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:15.404689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b85dc-c472-47b6-b5c7-457657939d43 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:15.413009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc36f42-261e-4d14-b0ca-09bccd4459fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:15.414660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc36f42-261e-4d14-b0ca-09bccd4459fe service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:15.414660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc36f42-261e-4d14-b0ca-09bccd4459fe service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:15.414660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc36f42-261e-4d14-b0ca-09bccd4459fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:15.428587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc36f42-261e-4d14-b0ca-09bccd4459fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:15.430382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc36f42-261e-4d14-b0ca-09bccd4459fe service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:15.443896 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1215/2432] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:44:18.487655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c764329-7e76-4ab3-8293-7161c9f9971b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:18.488183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c764329-7e76-4ab3-8293-7161c9f9971b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:18.488183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c764329-7e76-4ab3-8293-7161c9f9971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:18.509008 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4c764329-7e76-4ab3-8293-7161c9f9971b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:18.511164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4c764329-7e76-4ab3-8293-7161c9f9971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:18.519953 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1218/2433] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:44:18.539287 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc36f42-261e-4d14-b0ca-09bccd4459fe service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:18.540809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fdc36f42-261e-4d14-b0ca-09bccd4459fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:18.555974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc36f42-261e-4d14-b0ca-09bccd4459fe service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:18.564056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadeceb-e5d6-481a-9971-935e32d04f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:18.564668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadeceb-e5d6-481a-9971-935e32d04f4b service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:18.565133 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadeceb-e5d6-481a-9971-935e32d04f4b service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:18.565407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadeceb-e5d6-481a-9971-935e32d04f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:18.574418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadeceb-e5d6-481a-9971-935e32d04f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:18.576052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadeceb-e5d6-481a-9971-935e32d04f4b service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:18.586441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1216/2434] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:44:21.624149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81e0af-fcdf-4132-a085-5a5357da3208 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:21.624713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81e0af-fcdf-4132-a085-5a5357da3208 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:21.624713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81e0af-fcdf-4132-a085-5a5357da3208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:21.645031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-3e81e0af-fcdf-4132-a085-5a5357da3208 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:21.646157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3e81e0af-fcdf-4132-a085-5a5357da3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:21.654283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1219/2435] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:21.683913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadeceb-e5d6-481a-9971-935e32d04f4b service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:21.695405 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadeceb-e5d6-481a-9971-935e32d04f4b service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:21.700907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b1f8c-7fb2-4d4c-ad2b-0fce84885523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:21.701567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b1f8c-7fb2-4d4c-ad2b-0fce84885523 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:21.701849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b1f8c-7fb2-4d4c-ad2b-0fce84885523 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:21.702123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b1f8c-7fb2-4d4c-ad2b-0fce84885523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:21.711218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b1f8c-7fb2-4d4c-ad2b-0fce84885523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:21.713014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b1f8c-7fb2-4d4c-ad2b-0fce84885523 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:21.723182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1217/2436] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:44:25.824991 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881fb1-b82d-4843-a22a-c89de6ea0d9b None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:25.825486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881fb1-b82d-4843-a22a-c89de6ea0d9b None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:25.825583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c881fb1-b82d-4843-a22a-c89de6ea0d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:25.846503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-9c881fb1-b82d-4843-a22a-c89de6ea0d9b None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:25.848266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-9c881fb1-b82d-4843-a22a-c89de6ea0d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:25.859805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1220/2437] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:25.883258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b1f8c-7fb2-4d4c-ad2b-0fce84885523 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:25.896374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b1f8c-7fb2-4d4c-ad2b-0fce84885523 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:25.903155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb679f98-97e3-4ecc-a2e8-96185ed0de41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:25.903869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb679f98-97e3-4ecc-a2e8-96185ed0de41 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:25.904219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb679f98-97e3-4ecc-a2e8-96185ed0de41 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:25.904550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb679f98-97e3-4ecc-a2e8-96185ed0de41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:25.941371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb679f98-97e3-4ecc-a2e8-96185ed0de41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:25.943868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb679f98-97e3-4ecc-a2e8-96185ed0de41 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:25.966081 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1218/2438] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:44:30.074153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e779525-20f4-4275-b492-6213db79a05c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:30.074707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e779525-20f4-4275-b492-6213db79a05c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:30.074707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e779525-20f4-4275-b492-6213db79a05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:30.095582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-6e779525-20f4-4275-b492-6213db79a05c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:30.097101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6e779525-20f4-4275-b492-6213db79a05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:30.108633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1221/2439] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 04:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:30.125811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb679f98-97e3-4ecc-a2e8-96185ed0de41 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:30.137550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb679f98-97e3-4ecc-a2e8-96185ed0de41 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:30.143310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156b866-2959-402a-b34d-0bb997a0cdb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:30.143934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156b866-2959-402a-b34d-0bb997a0cdb2 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:30.144213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156b866-2959-402a-b34d-0bb997a0cdb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:30.144485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156b866-2959-402a-b34d-0bb997a0cdb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:30.154159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156b866-2959-402a-b34d-0bb997a0cdb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:30.155792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156b866-2959-402a-b34d-0bb997a0cdb2 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:30.166936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1219/2440] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:44:40.089792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=59 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:40.161303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=28 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:46.157107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60591387-6000-47fb-8cd7-7ff176cd0b49 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:46.157656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60591387-6000-47fb-8cd7-7ff176cd0b49 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:46.157750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60591387-6000-47fb-8cd7-7ff176cd0b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:46.193731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-60591387-6000-47fb-8cd7-7ff176cd0b49 None None] MFA Rules not processed for user `3264fa6c4cea48ba89955c9bb0c233ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:46.194978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-60591387-6000-47fb-8cd7-7ff176cd0b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:46.268761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1222/2441] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:44:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:46.545949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156b866-2959-402a-b34d-0bb997a0cdb2 service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:46.559461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156b866-2959-402a-b34d-0bb997a0cdb2 service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:46.565022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:46.566145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:46.566523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:46.566892 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] PATH_INFO: `/v3/users/1b4de8d8d0c54e99b84a07b3fd8a8aab` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:46.568336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b4de8d8d0c54e99b84a07b3fd8a8aab)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:46.570435 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:46.659694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4de8d8d0c54e99b84a07b3fd8a8aab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:46.660526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4de8d8d0c54e99b84a07b3fd8a8aab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:46.685981 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4de8d8d0c54e99b84a07b3fd8a8aab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:46.693575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4de8d8d0c54e99b84a07b3fd8a8aab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:46.702708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4de8d8d0c54e99b84a07b3fd8a8aab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:46.709583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1220/2442] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:44:46 2022] DELETE /identity/v3/users/1b4de8d8d0c54e99b84a07b3fd8a8aab => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:44:46.714572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154d97-9c96-4815-b5d5-2c32c780c969 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:46.714963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154d97-9c96-4815-b5d5-2c32c780c969 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:46.715268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154d97-9c96-4815-b5d5-2c32c780c969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:46.735768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-61154d97-9c96-4815-b5d5-2c32c780c969 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:46.737365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-61154d97-9c96-4815-b5d5-2c32c780c969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:46.819261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1223/2443] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:46.831837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:46.833490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:46.904562 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd011af5-b6e8-4be4-8f7e-90ea1a866040 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:46.908614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64c10d-ff5e-4dd7-98f0-4ec20db7d201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:46.909247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64c10d-ff5e-4dd7-98f0-4ec20db7d201 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:46.909530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64c10d-ff5e-4dd7-98f0-4ec20db7d201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:46.910011 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64c10d-ff5e-4dd7-98f0-4ec20db7d201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:46.924221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64c10d-ff5e-4dd7-98f0-4ec20db7d201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:46.925973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64c10d-ff5e-4dd7-98f0-4ec20db7d201 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:46.939684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1221/2444] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:44:47.388007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61154d97-9c96-4815-b5d5-2c32c780c969 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:44:47.389849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-61154d97-9c96-4815-b5d5-2c32c780c969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:47.410415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61154d97-9c96-4815-b5d5-2c32c780c969 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:44:47.418658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:44:47.419671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:47.420208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:47.420691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] PATH_INFO: `/v3/projects/09ea270f3df94a6598daaa9e6e958040` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:47.422474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ea270f3df94a6598daaa9e6e958040)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:44:47.425417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:44:47.496623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ea270f3df94a6598daaa9e6e958040', 'request_id': 'req-cc9be94a-cd77-458d-aeb3-5397d16bd651'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:47.502604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ea270f3df94a6598daaa9e6e958040', 'request_id': 'req-cc9be94a-cd77-458d-aeb3-5397d16bd651'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:47.514127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ea270f3df94a6598daaa9e6e958040', 'request_id': 'req-cc9be94a-cd77-458d-aeb3-5397d16bd651'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:47.529205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] The token cache is being invalidate because project 09ea270f3df94a6598daaa9e6e958040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:44:47.529506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:47.530049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:44:47.531647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1224/2445] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:44:47 2022] DELETE /identity/v3/projects/09ea270f3df94a6598daaa9e6e958040 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:44:48.691423 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ebe16-5428-48a1-9f9c-2c4f1ee649c9 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:44:48.691825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ebe16-5428-48a1-9f9c-2c4f1ee649c9 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:44:48.691922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ebe16-5428-48a1-9f9c-2c4f1ee649c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:44:48.711723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-503ebe16-5428-48a1-9f9c-2c4f1ee649c9 None None] MFA Rules not processed for user `41e527395daf428ab00fd78c2412ed13`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:44:48.713314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-503ebe16-5428-48a1-9f9c-2c4f1ee649c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:44:48.779463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1222/2446] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:44:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:44:57.524187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:44:58.771805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:02.180016 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:02.181539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:02.253636 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9be94a-cd77-458d-aeb3-5397d16bd651 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:02.258389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:02.259104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:02.259383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:02.259657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] PATH_INFO: `/v3/users/6edff1bb210b4bf882b83feb2644dfa8` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:02.260871 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6edff1bb210b4bf882b83feb2644dfa8)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:02.262837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:02.313282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6edff1bb210b4bf882b83feb2644dfa8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.313947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6edff1bb210b4bf882b83feb2644dfa8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.326200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6edff1bb210b4bf882b83feb2644dfa8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.333093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6edff1bb210b4bf882b83feb2644dfa8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.333713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bb25ed2c-6ce3-4675-a892-3f3ca27413dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6edff1bb210b4bf882b83feb2644dfa8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.346376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1225/2447] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:45:02 2022] DELETE /identity/v3/users/6edff1bb210b4bf882b83feb2644dfa8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:45:02.525314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ebe16-5428-48a1-9f9c-2c4f1ee649c9 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:02.538192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ebe16-5428-48a1-9f9c-2c4f1ee649c9 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:02.613223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:02.613872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:02.614146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:02.614392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] PATH_INFO: `/v3/projects/13201c3c66be4afa8c4716b9fff315c3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:02.616501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13201c3c66be4afa8c4716b9fff315c3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:02.620174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:02.683746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13201c3c66be4afa8c4716b9fff315c3', 'request_id': 'req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.689377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13201c3c66be4afa8c4716b9fff315c3', 'request_id': 'req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.697269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13201c3c66be4afa8c4716b9fff315c3', 'request_id': 'req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.709454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] The token cache is being invalidate because project 13201c3c66be4afa8c4716b9fff315c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:45:02.709748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.710402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ecd9adbe-c69e-4cb6-b9dc-db11464949e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:45:02.712638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1223/2448] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:45:02 2022] DELETE /identity/v3/projects/13201c3c66be4afa8c4716b9fff315c3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:45:02.717913 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91473cd4-43cd-4085-96e7-86e94876ccac None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:02.718205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91473cd4-43cd-4085-96e7-86e94876ccac None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:02.718483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91473cd4-43cd-4085-96e7-86e94876ccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:02.739324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-91473cd4-43cd-4085-96e7-86e94876ccac None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:45:02.740533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-91473cd4-43cd-4085-96e7-86e94876ccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:02.955727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1226/2449] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:45:03.020360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d2bef-6482-483a-aa4f-a3c8b208b219 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:03.020638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d2bef-6482-483a-aa4f-a3c8b208b219 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:03.020907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d2bef-6482-483a-aa4f-a3c8b208b219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:03.041067 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f56d2bef-6482-483a-aa4f-a3c8b208b219 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:45:03.042253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f56d2bef-6482-483a-aa4f-a3c8b208b219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:03.050145 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1224/2450] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:45:03.054542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91473cd4-43cd-4085-96e7-86e94876ccac None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:03.064480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91473cd4-43cd-4085-96e7-86e94876ccac None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:03.069081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a09dc0-3683-4a89-a7a2-48c444754287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:03.069801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a09dc0-3683-4a89-a7a2-48c444754287 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:03.070101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a09dc0-3683-4a89-a7a2-48c444754287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:03.070877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a09dc0-3683-4a89-a7a2-48c444754287 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:03.071603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a09dc0-3683-4a89-a7a2-48c444754287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:45:03.071907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a09dc0-3683-4a89-a7a2-48c444754287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:03.073473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a09dc0-3683-4a89-a7a2-48c444754287 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:03.085286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1227/2451] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:45:03.090161 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d2bef-6482-483a-aa4f-a3c8b208b219 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:03.099481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d2bef-6482-483a-aa4f-a3c8b208b219 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:03.104077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e793f3-987c-4517-8ac2-ae1d34c2f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:03.104680 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e793f3-987c-4517-8ac2-ae1d34c2f1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:03.104952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e793f3-987c-4517-8ac2-ae1d34c2f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:03.105215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e793f3-987c-4517-8ac2-ae1d34c2f1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:03.105857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e793f3-987c-4517-8ac2-ae1d34c2f1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:03.107769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e793f3-987c-4517-8ac2-ae1d34c2f1bd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:03.135355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1225/2452] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:45:03 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:45:03.139602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a09dc0-3683-4a89-a7a2-48c444754287 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:03.149314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a09dc0-3683-4a89-a7a2-48c444754287 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:03.152794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:03.207389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54853e-13af-4aba-b2e6-fa613b7eca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:03.208039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54853e-13af-4aba-b2e6-fa613b7eca89 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:03.208255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54853e-13af-4aba-b2e6-fa613b7eca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:03.208521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54853e-13af-4aba-b2e6-fa613b7eca89 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:03.209164 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54853e-13af-4aba-b2e6-fa613b7eca89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:03.211056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54853e-13af-4aba-b2e6-fa613b7eca89 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:03.231340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1228/2453] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:45:03 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:45:03.236546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e793f3-987c-4517-8ac2-ae1d34c2f1bd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:03.247505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e793f3-987c-4517-8ac2-ae1d34c2f1bd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:03.252143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4183ab-4966-47fa-93a1-de702f27bb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:03.252742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4183ab-4966-47fa-93a1-de702f27bb38 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:03.253016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4183ab-4966-47fa-93a1-de702f27bb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:03.253283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4183ab-4966-47fa-93a1-de702f27bb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:03.253964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4183ab-4966-47fa-93a1-de702f27bb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:03.255640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4183ab-4966-47fa-93a1-de702f27bb38 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:03.266281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1226/2454] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:45:03.270293 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54853e-13af-4aba-b2e6-fa613b7eca89 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:03.280066 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54853e-13af-4aba-b2e6-fa613b7eca89 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:03.284829 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7e4ca-8c18-461c-9205-3c023610c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:03.285432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7e4ca-8c18-461c-9205-3c023610c9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:03.285716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7e4ca-8c18-461c-9205-3c023610c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:03.286263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7e4ca-8c18-461c-9205-3c023610c9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:03.286941 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7e4ca-8c18-461c-9205-3c023610c9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:03.288542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7e4ca-8c18-461c-9205-3c023610c9a2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:03.298926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1229/2455] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:45:03.303189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4183ab-4966-47fa-93a1-de702f27bb38 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:03.313717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4183ab-4966-47fa-93a1-de702f27bb38 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:03.318383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cdf8f-20a8-4ad2-8998-b62e040737f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:03.319105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cdf8f-20a8-4ad2-8998-b62e040737f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:03.319388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cdf8f-20a8-4ad2-8998-b62e040737f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:03.319666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cdf8f-20a8-4ad2-8998-b62e040737f7 admin admin] PATH_INFO: `/v3/projects/fa6d3ceabd634b67bdbb5e3d5af9bd0d/users/ccd5adafa7b0465988e758ebe7b29dc2/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:03.334960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cdf8f-20a8-4ad2-8998-b62e040737f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6d3ceabd634b67bdbb5e3d5af9bd0d, user_id=ccd5adafa7b0465988e758ebe7b29dc2, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:03.337700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cdf8f-20a8-4ad2-8998-b62e040737f7 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:03.351357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1227/2456] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:45:03 2022] PUT /identity/v3/projects/fa6d3ceabd634b67bdbb5e3d5af9bd0d/users/ccd5adafa7b0465988e758ebe7b29dc2/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:45:03.356528 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e3f45-feaf-4b45-8c53-6941374a7557 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:03.356889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e3f45-feaf-4b45-8c53-6941374a7557 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:03.357255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e3f45-feaf-4b45-8c53-6941374a7557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:03.376934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-596e3f45-feaf-4b45-8c53-6941374a7557 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:45:03.378127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-596e3f45-feaf-4b45-8c53-6941374a7557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:03.440267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1230/2457] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:45:03.455822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cdf8f-20a8-4ad2-8998-b62e040737f7 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:03.457600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-417cdf8f-20a8-4ad2-8998-b62e040737f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:03.490001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:03.519705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cdf8f-20a8-4ad2-8998-b62e040737f7 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:03.533523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833eeb5-e6d3-48de-be9a-1a3c25e81577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:03.534225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833eeb5-e6d3-48de-be9a-1a3c25e81577 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:03.534429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833eeb5-e6d3-48de-be9a-1a3c25e81577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:03.534700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833eeb5-e6d3-48de-be9a-1a3c25e81577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:03.546808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833eeb5-e6d3-48de-be9a-1a3c25e81577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:03.548269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833eeb5-e6d3-48de-be9a-1a3c25e81577 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:03.558899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1228/2458] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:45:08.178724 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55926072-e104-4dfc-af76-c1c34b09c12f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:08.179348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55926072-e104-4dfc-af76-c1c34b09c12f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:08.180554 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55926072-e104-4dfc-af76-c1c34b09c12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:08.213756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-55926072-e104-4dfc-af76-c1c34b09c12f None None] MFA Rules not processed for user `ccd5adafa7b0465988e758ebe7b29dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:45:08.215122 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-55926072-e104-4dfc-af76-c1c34b09c12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:08.303626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1231/2459] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:45:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:45:08.308936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833eeb5-e6d3-48de-be9a-1a3c25e81577 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:08.324603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833eeb5-e6d3-48de-be9a-1a3c25e81577 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:08.329637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa93ef-1353-4869-8322-401b61954440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:08.330332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa93ef-1353-4869-8322-401b61954440 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:08.330619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa93ef-1353-4869-8322-401b61954440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:08.330889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa93ef-1353-4869-8322-401b61954440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:08.331598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa93ef-1353-4869-8322-401b61954440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:08.333501 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa93ef-1353-4869-8322-401b61954440 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:08.363388 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1229/2460] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:45:08 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:45:08.367494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55926072-e104-4dfc-af76-c1c34b09c12f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:08.378363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55926072-e104-4dfc-af76-c1c34b09c12f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:08.391906 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:08.442038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e39ee3-c2f2-450d-9d46-5b116d004cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:08.442664 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e39ee3-c2f2-450d-9d46-5b116d004cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:08.442945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e39ee3-c2f2-450d-9d46-5b116d004cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:08.443281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e39ee3-c2f2-450d-9d46-5b116d004cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:08.443936 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e39ee3-c2f2-450d-9d46-5b116d004cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:08.445863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e39ee3-c2f2-450d-9d46-5b116d004cc8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:08.468746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1232/2461] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:45:08 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:45:08.473027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa93ef-1353-4869-8322-401b61954440 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:08.485050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa93ef-1353-4869-8322-401b61954440 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:08.489725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2f462-1505-405d-8257-a45a66745e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:08.490348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2f462-1505-405d-8257-a45a66745e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:08.490622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2f462-1505-405d-8257-a45a66745e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:08.490890 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2f462-1505-405d-8257-a45a66745e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:08.491617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2f462-1505-405d-8257-a45a66745e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:08.493439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2f462-1505-405d-8257-a45a66745e85 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:08.504729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1230/2462] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:45:08.509093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e39ee3-c2f2-450d-9d46-5b116d004cc8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:08.520567 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e39ee3-c2f2-450d-9d46-5b116d004cc8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:08.526949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5096-0d30-4e64-878e-b4faf65586d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:08.527659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5096-0d30-4e64-878e-b4faf65586d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:08.527941 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5096-0d30-4e64-878e-b4faf65586d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:08.528217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5096-0d30-4e64-878e-b4faf65586d6 admin admin] PATH_INFO: `/v3/projects/6cd97299ae5c45ec95c094c080b69991/users/3f27f24f0676479a9b5869f8cc425cb3/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:08.544925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b5096-0d30-4e64-878e-b4faf65586d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd97299ae5c45ec95c094c080b69991, user_id=3f27f24f0676479a9b5869f8cc425cb3, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:08.547649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b5096-0d30-4e64-878e-b4faf65586d6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:08.561352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1233/2463] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:45:08 2022] PUT /identity/v3/projects/6cd97299ae5c45ec95c094c080b69991/users/3f27f24f0676479a9b5869f8cc425cb3/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:45:08.565556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2f462-1505-405d-8257-a45a66745e85 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:08.575995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2f462-1505-405d-8257-a45a66745e85 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:08.635159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7c125-40a9-480f-9b95-ba42db0a3b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:08.635773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7c125-40a9-480f-9b95-ba42db0a3b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:08.636055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7c125-40a9-480f-9b95-ba42db0a3b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:08.636323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7c125-40a9-480f-9b95-ba42db0a3b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:08.637018 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7c125-40a9-480f-9b95-ba42db0a3b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:08.638607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7c125-40a9-480f-9b95-ba42db0a3b72 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:08.652769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1231/2464] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:45:08.653935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5096-0d30-4e64-878e-b4faf65586d6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:08.666235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5096-0d30-4e64-878e-b4faf65586d6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:08.671498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63f9eb-59a4-4833-9952-21fe990cabae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:08.672250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63f9eb-59a4-4833-9952-21fe990cabae admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:08.672603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63f9eb-59a4-4833-9952-21fe990cabae admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:08.673070 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63f9eb-59a4-4833-9952-21fe990cabae admin admin] PATH_INFO: `/v3/projects/6cd97299ae5c45ec95c094c080b69991/users/3f27f24f0676479a9b5869f8cc425cb3/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:08.675160 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63f9eb-59a4-4833-9952-21fe990cabae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd97299ae5c45ec95c094c080b69991, user_id=3f27f24f0676479a9b5869f8cc425cb3, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:08.677947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63f9eb-59a4-4833-9952-21fe990cabae admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:08.689296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1234/2465] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:45:08 2022] PUT /identity/v3/projects/6cd97299ae5c45ec95c094c080b69991/users/3f27f24f0676479a9b5869f8cc425cb3/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:45:14.046537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb70452-adc2-45e4-8a7d-0a70c88dec8a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:14.046976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb70452-adc2-45e4-8a7d-0a70c88dec8a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:14.047433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb70452-adc2-45e4-8a7d-0a70c88dec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:14.090106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-4bb70452-adc2-45e4-8a7d-0a70c88dec8a None None] MFA Rules not processed for user `3f27f24f0676479a9b5869f8cc425cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:45:14.092222 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4bb70452-adc2-45e4-8a7d-0a70c88dec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:14.189380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1232/2466] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:45:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:45:14.198583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63f9eb-59a4-4833-9952-21fe990cabae admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:14.200521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dd63f9eb-59a4-4833-9952-21fe990cabae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:14.266516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63f9eb-59a4-4833-9952-21fe990cabae admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:14.270240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd17cea-cf12-42af-b444-71b1044c54b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955c6cb8893c473fadd028b12bbea69d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:14.270855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd17cea-cf12-42af-b444-71b1044c54b1 service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:14.271185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd17cea-cf12-42af-b444-71b1044c54b1 service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:14.271456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd17cea-cf12-42af-b444-71b1044c54b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:14.341283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd17cea-cf12-42af-b444-71b1044c54b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:14.342775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd17cea-cf12-42af-b444-71b1044c54b1 service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:14.356488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1235/2467] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:45:14.494308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe6f2c-2a98-4cbd-9b3e-9f66b0337fe2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:14.494678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe6f2c-2a98-4cbd-9b3e-9f66b0337fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:14.495036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe6f2c-2a98-4cbd-9b3e-9f66b0337fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:14.517923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-0fbe6f2c-2a98-4cbd-9b3e-9f66b0337fe2 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:45:14.520925 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-0fbe6f2c-2a98-4cbd-9b3e-9f66b0337fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:14.534493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:14.583387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1233/2468] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:45:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:45:14.631415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd17cea-cf12-42af-b444-71b1044c54b1 service glance] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:14.633460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-acd17cea-cf12-42af-b444-71b1044c54b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:14.659734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:14.703384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd17cea-cf12-42af-b444-71b1044c54b1 service glance] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:14.708238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0ee1f-096a-4d0e-8592-b50fbffa0525 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:14.708848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0ee1f-096a-4d0e-8592-b50fbffa0525 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:14.709123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0ee1f-096a-4d0e-8592-b50fbffa0525 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:14.709389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0ee1f-096a-4d0e-8592-b50fbffa0525 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:14.717444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0ee1f-096a-4d0e-8592-b50fbffa0525 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:14.719027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0ee1f-096a-4d0e-8592-b50fbffa0525 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:14.727415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1236/2469] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:23.917643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eee579-98c1-46d8-8740-d0893cf4f16f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:23.918198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eee579-98c1-46d8-8740-d0893cf4f16f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:23.918198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eee579-98c1-46d8-8740-d0893cf4f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:23.938811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d0eee579-98c1-46d8-8740-d0893cf4f16f None None] MFA Rules not processed for user `ccd5adafa7b0465988e758ebe7b29dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:45:23.940043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d0eee579-98c1-46d8-8740-d0893cf4f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:23.948799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1234/2470] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:45:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:45:24.535497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0ee1f-096a-4d0e-8592-b50fbffa0525 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:24.537295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-beb0ee1f-096a-4d0e-8592-b50fbffa0525 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:24.605840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0ee1f-096a-4d0e-8592-b50fbffa0525 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:24.609657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7588d1b-4bb4-45a4-b7ba-55b8d5d301bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:24.610286 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7588d1b-4bb4-45a4-b7ba-55b8d5d301bc service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:24.610564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7588d1b-4bb4-45a4-b7ba-55b8d5d301bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:24.610834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7588d1b-4bb4-45a4-b7ba-55b8d5d301bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:24.612708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c7588d1b-4bb4-45a4-b7ba-55b8d5d301bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:24.706777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7588d1b-4bb4-45a4-b7ba-55b8d5d301bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:24.708262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7588d1b-4bb4-45a4-b7ba-55b8d5d301bc service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:24.722515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1237/2471] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:45:24.957031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eee579-98c1-46d8-8740-d0893cf4f16f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:24.969070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eee579-98c1-46d8-8740-d0893cf4f16f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:24.976670 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f62c6d-5a6c-4b3d-94af-7d4c74a5d8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:24.979126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f62c6d-5a6c-4b3d-94af-7d4c74a5d8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:24.979587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f62c6d-5a6c-4b3d-94af-7d4c74a5d8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:24.980014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f62c6d-5a6c-4b3d-94af-7d4c74a5d8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:24.983652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-21f62c6d-5a6c-4b3d-94af-7d4c74a5d8f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:25.001006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f62c6d-5a6c-4b3d-94af-7d4c74a5d8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:25.013109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f62c6d-5a6c-4b3d-94af-7d4c74a5d8f2 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:25.025831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1235/2472] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:45:25.913189 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d41cf-4366-4dc8-a37f-f1273f74ccc8 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:25.913590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d41cf-4366-4dc8-a37f-f1273f74ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:25.913884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d41cf-4366-4dc8-a37f-f1273f74ccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:25.934934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-986d41cf-4366-4dc8-a37f-f1273f74ccc8 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:45:25.936284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-986d41cf-4366-4dc8-a37f-f1273f74ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:25.943585 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1238/2473] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:45:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:45:25.957180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f62c6d-5a6c-4b3d-94af-7d4c74a5d8f2 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:25.968524 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f62c6d-5a6c-4b3d-94af-7d4c74a5d8f2 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:25.974374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8e553-8735-460b-ac9c-e9b01cd1613c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:25.975037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8e553-8735-460b-ac9c-e9b01cd1613c service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:25.975937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8e553-8735-460b-ac9c-e9b01cd1613c service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:25.976407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8e553-8735-460b-ac9c-e9b01cd1613c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:25.986112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8e553-8735-460b-ac9c-e9b01cd1613c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:25.987658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8e553-8735-460b-ac9c-e9b01cd1613c service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:25.997056 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1236/2474] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:35.911205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d41cf-4366-4dc8-a37f-f1273f74ccc8 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:35.914118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-986d41cf-4366-4dc8-a37f-f1273f74ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:35.930245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d41cf-4366-4dc8-a37f-f1273f74ccc8 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:35.936500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced9a31-2c7f-4356-8371-9486526ad504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:35.937403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced9a31-2c7f-4356-8371-9486526ad504 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:35.937694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced9a31-2c7f-4356-8371-9486526ad504 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:35.937968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced9a31-2c7f-4356-8371-9486526ad504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:35.939912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4ced9a31-2c7f-4356-8371-9486526ad504 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:35.991718 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:35.993456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=32 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:36.009679 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced9a31-2c7f-4356-8371-9486526ad504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:36.012160 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced9a31-2c7f-4356-8371-9486526ad504 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:36.028327 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1239/2475] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:45:38.277519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8e553-8735-460b-ac9c-e9b01cd1613c service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:38.293637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8e553-8735-460b-ac9c-e9b01cd1613c service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:38.299658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49bae9-81c9-4101-a721-f7778317790b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:38.300396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49bae9-81c9-4101-a721-f7778317790b service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:38.300701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49bae9-81c9-4101-a721-f7778317790b service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:38.300974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49bae9-81c9-4101-a721-f7778317790b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:38.302863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-eb49bae9-81c9-4101-a721-f7778317790b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:38.364596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49bae9-81c9-4101-a721-f7778317790b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:38.366261 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49bae9-81c9-4101-a721-f7778317790b service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:38.375730 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1237/2476] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:45:42.695289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38bd43-aa49-4230-872a-7a2b0f16fa5c None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:42.695882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38bd43-aa49-4230-872a-7a2b0f16fa5c None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:42.695982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38bd43-aa49-4230-872a-7a2b0f16fa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:42.718015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bd38bd43-aa49-4230-872a-7a2b0f16fa5c None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:45:42.719288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bd38bd43-aa49-4230-872a-7a2b0f16fa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:42.726760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1240/2477] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:45:42.740021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49bae9-81c9-4101-a721-f7778317790b service nova] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:42.752998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49bae9-81c9-4101-a721-f7778317790b service nova] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:42.762879 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87594fc3-58b6-4022-9249-fb3f7829cd5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:42.763555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87594fc3-58b6-4022-9249-fb3f7829cd5c service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:42.763830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87594fc3-58b6-4022-9249-fb3f7829cd5c service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:42.764103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87594fc3-58b6-4022-9249-fb3f7829cd5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:42.777683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87594fc3-58b6-4022-9249-fb3f7829cd5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:42.779335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87594fc3-58b6-4022-9249-fb3f7829cd5c service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:42.790282 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1238/2478] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:45:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:45:43.968154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38bd43-aa49-4230-872a-7a2b0f16fa5c None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:43.993022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38bd43-aa49-4230-872a-7a2b0f16fa5c None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:44.010962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e38f0-85c8-4808-b49f-309eea8aef27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:44.011950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e38f0-85c8-4808-b49f-309eea8aef27 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:44.013007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e38f0-85c8-4808-b49f-309eea8aef27 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:44.013457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e38f0-85c8-4808-b49f-309eea8aef27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:44.017209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-693e38f0-85c8-4808-b49f-309eea8aef27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:44.130017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e38f0-85c8-4808-b49f-309eea8aef27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:44.132670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e38f0-85c8-4808-b49f-309eea8aef27 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:44.149206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1241/2479] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:45:52.785432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=34 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:53.303690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87594fc3-58b6-4022-9249-fb3f7829cd5c service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:53.318432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87594fc3-58b6-4022-9249-fb3f7829cd5c service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:53.328442 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644d7da-56b6-4164-887c-b6ffcda05f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:53.329439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644d7da-56b6-4164-887c-b6ffcda05f4e service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:53.330950 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644d7da-56b6-4164-887c-b6ffcda05f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:53.331454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644d7da-56b6-4164-887c-b6ffcda05f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:53.350666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644d7da-56b6-4164-887c-b6ffcda05f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:53.356337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644d7da-56b6-4164-887c-b6ffcda05f4e service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:53.399253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1239/2480] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:45:54.139152 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=38 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:45:57.789333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e38f0-85c8-4808-b49f-309eea8aef27 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:57.799020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e38f0-85c8-4808-b49f-309eea8aef27 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:57.811245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644d7da-56b6-4164-887c-b6ffcda05f4e service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:45:57.812974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a924f-06c6-4128-87e9-145efe7c8efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:57.813611 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a924f-06c6-4128-87e9-145efe7c8efc service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:57.813901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a924f-06c6-4128-87e9-145efe7c8efc service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:57.814161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a924f-06c6-4128-87e9-145efe7c8efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:57.816262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5c7a924f-06c6-4128-87e9-145efe7c8efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:45:57.818726 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644d7da-56b6-4164-887c-b6ffcda05f4e service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:45:57.825163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98f113-b49b-455f-9a6a-29506a71003a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:45:57.826963 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98f113-b49b-455f-9a6a-29506a71003a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:45:57.827552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98f113-b49b-455f-9a6a-29506a71003a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:45:57.828039 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98f113-b49b-455f-9a6a-29506a71003a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:45:57.828377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a924f-06c6-4128-87e9-145efe7c8efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:57.829939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a924f-06c6-4128-87e9-145efe7c8efc service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:57.840191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1242/2481] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:45:57.842264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98f113-b49b-455f-9a6a-29506a71003a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:45:57.845264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98f113-b49b-455f-9a6a-29506a71003a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:45:57.861313 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1240/2482] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:02.179347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a924f-06c6-4128-87e9-145efe7c8efc service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:02.188807 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a924f-06c6-4128-87e9-145efe7c8efc service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:02.211535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:02.212723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:02.212723 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:02.213462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:02.214847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:02.287846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:02.289282 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:02.301237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1243/2483] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:03.500360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98f113-b49b-455f-9a6a-29506a71003a service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:03.517252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98f113-b49b-455f-9a6a-29506a71003a service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:03.522250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:03.523576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:03.524382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:03.524817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:03.528062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:03.540333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:03.541888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:03.554784 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1241/2484] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:04.009334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:04.010725 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:04.087789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bbf98-c231-45d7-a1b0-906e63ee3de3 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:04.093045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:04.093675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:04.093954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:04.094227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:04.096039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:04.109099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:04.110703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:04.123586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1244/2485] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:05.761919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:05.765380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:05.797913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c6c75-56c8-497a-9870-40ff655ecfdf service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:05.816663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1c072-9a7d-449b-b3dc-84f323f672c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:05.817245 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c072-9a7d-449b-b3dc-84f323f672c5 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:05.817539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c072-9a7d-449b-b3dc-84f323f672c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:05.817800 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1c072-9a7d-449b-b3dc-84f323f672c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:05.823265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bec1c072-9a7d-449b-b3dc-84f323f672c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:05.854556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1c072-9a7d-449b-b3dc-84f323f672c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:05.856334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1c072-9a7d-449b-b3dc-84f323f672c5 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:05.895877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1242/2486] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:06.788253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:06.790416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:06.835257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a9358-cfa7-4fac-a13c-6411ad7644bb service placement] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:06.844629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:06.845777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:06.846267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:06.846737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] PATH_INFO: `/v3/users/41e527395daf428ab00fd78c2412ed13` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:06.848554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2003-4310-4e1e-9e79-988fe6ed4ad4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:06.849341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2003-4310-4e1e-9e79-988fe6ed4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:06.849341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2003-4310-4e1e-9e79-988fe6ed4ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:06.851234 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e527395daf428ab00fd78c2412ed13)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:06.854506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:06.904119 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3a9f2003-4310-4e1e-9e79-988fe6ed4ad4 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:06.905429 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3a9f2003-4310-4e1e-9e79-988fe6ed4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:06.927192 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1243/2487] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Aug 4 04:46:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:46:06.948100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2003-4310-4e1e-9e79-988fe6ed4ad4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:06.967332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2003-4310-4e1e-9e79-988fe6ed4ad4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:06.972539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e527395daf428ab00fd78c2412ed13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:06.974390 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fba8dd-d0d4-42e6-a705-e03f154f3cdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:06.974937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e527395daf428ab00fd78c2412ed13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:06.975264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fba8dd-d0d4-42e6-a705-e03f154f3cdd service swift] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:06.977696 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fba8dd-d0d4-42e6-a705-e03f154f3cdd service swift] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:06.978891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fba8dd-d0d4-42e6-a705-e03f154f3cdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:06.991087 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fba8dd-d0d4-42e6-a705-e03f154f3cdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:06.992946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fba8dd-d0d4-42e6-a705-e03f154f3cdd service swift] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:07.000483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e527395daf428ab00fd78c2412ed13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:07.002812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:07.003196 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1244/2488] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:46:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 04:46:07.019562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e527395daf428ab00fd78c2412ed13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:07.020451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-865936bb-7ead-462c-a90e-b147b43dfa98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e527395daf428ab00fd78c2412ed13'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:07.051613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1245/2489] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:06 2022] DELETE /identity/v3/users/41e527395daf428ab00fd78c2412ed13 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:07.393830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fba8dd-d0d4-42e6-a705-e03f154f3cdd service swift] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:07.415141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fba8dd-d0d4-42e6-a705-e03f154f3cdd service swift] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:07.615031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:07.616715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:07.617254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:07.617684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] PATH_INFO: `/v3/projects/84a9b58a917346379c0d7492c19ba0ac` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:07.619257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a9b58a917346379c0d7492c19ba0ac)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:07.621398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:07.737560 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a9b58a917346379c0d7492c19ba0ac', 'request_id': 'req-8f465012-d945-4f07-99ca-86cd50efeda3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:07.746660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a9b58a917346379c0d7492c19ba0ac', 'request_id': 'req-8f465012-d945-4f07-99ca-86cd50efeda3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:07.760077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a9b58a917346379c0d7492c19ba0ac', 'request_id': 'req-8f465012-d945-4f07-99ca-86cd50efeda3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:07.776760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] The token cache is being invalidate because project 84a9b58a917346379c0d7492c19ba0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:07.777539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:07.778619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8f465012-d945-4f07-99ca-86cd50efeda3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:07.781089 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1245/2490] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:07 2022] DELETE /identity/v3/projects/84a9b58a917346379c0d7492c19ba0ac => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:07.787935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a881-4ccf-419e-b8af-f7076b297307 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:07.788618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a881-4ccf-419e-b8af-f7076b297307 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:07.797503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a881-4ccf-419e-b8af-f7076b297307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:07.838765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1bc9a881-4ccf-419e-b8af-f7076b297307 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:07.840584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1bc9a881-4ccf-419e-b8af-f7076b297307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:07.989622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1246/2491] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:07.997183 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431277-b47e-44e1-baa6-4a800560abe1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:07.997792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431277-b47e-44e1-baa6-4a800560abe1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:07.997792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431277-b47e-44e1-baa6-4a800560abe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:08.041540 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-dd431277-b47e-44e1-baa6-4a800560abe1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:08.051941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd431277-b47e-44e1-baa6-4a800560abe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:08.073865 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1246/2492] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:08.075208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a881-4ccf-419e-b8af-f7076b297307 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:08.086399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a881-4ccf-419e-b8af-f7076b297307 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:08.092924 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d7139-4dae-4f27-b77b-3fc898325e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:08.093180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d7139-4dae-4f27-b77b-3fc898325e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:08.093368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d7139-4dae-4f27-b77b-3fc898325e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:08.093640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d7139-4dae-4f27-b77b-3fc898325e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:08.105717 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d7139-4dae-4f27-b77b-3fc898325e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:46:08.106039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d7139-4dae-4f27-b77b-3fc898325e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:08.107783 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d7139-4dae-4f27-b77b-3fc898325e33 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:08.138178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1247/2493] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:46:08.142436 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd431277-b47e-44e1-baa6-4a800560abe1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:08.167838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd431277-b47e-44e1-baa6-4a800560abe1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:08.193041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a3bd-edf7-4987-96f2-074a31fcfcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:08.193041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a3bd-edf7-4987-96f2-074a31fcfcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:08.193041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a3bd-edf7-4987-96f2-074a31fcfcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:08.193041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a3bd-edf7-4987-96f2-074a31fcfcc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:08.193516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005a3bd-edf7-4987-96f2-074a31fcfcc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:08.205338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005a3bd-edf7-4987-96f2-074a31fcfcc3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:08.218351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:08.278418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1247/2494] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:08 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:08.282814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d7139-4dae-4f27-b77b-3fc898325e33 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:08.294748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d7139-4dae-4f27-b77b-3fc898325e33 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:08.386289 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f5d72-7a52-4bfb-b77e-2c3ab0b8b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:08.386928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f5d72-7a52-4bfb-b77e-2c3ab0b8b4fc admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:08.387278 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f5d72-7a52-4bfb-b77e-2c3ab0b8b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:08.387545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f5d72-7a52-4bfb-b77e-2c3ab0b8b4fc admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:08.388283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f5d72-7a52-4bfb-b77e-2c3ab0b8b4fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:08.390235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f5d72-7a52-4bfb-b77e-2c3ab0b8b4fc admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:08.417781 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1248/2495] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:08 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:46:08.419682 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a3bd-edf7-4987-96f2-074a31fcfcc3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:08.436737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a3bd-edf7-4987-96f2-074a31fcfcc3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:08.451644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc508d2-c432-4869-813f-b6353e35c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:08.452283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc508d2-c432-4869-813f-b6353e35c33b admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:08.452574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc508d2-c432-4869-813f-b6353e35c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:08.453078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc508d2-c432-4869-813f-b6353e35c33b admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:08.453593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc508d2-c432-4869-813f-b6353e35c33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:08.455210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc508d2-c432-4869-813f-b6353e35c33b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:08.466849 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1248/2496] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:08.471326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f5d72-7a52-4bfb-b77e-2c3ab0b8b4fc admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:08.482025 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f5d72-7a52-4bfb-b77e-2c3ab0b8b4fc admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:08.487457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abd924-db25-411e-b66b-6c522e11729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:08.488169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abd924-db25-411e-b66b-6c522e11729b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:08.489097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abd924-db25-411e-b66b-6c522e11729b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:08.489441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abd924-db25-411e-b66b-6c522e11729b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:08.490227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abd924-db25-411e-b66b-6c522e11729b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:08.491995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abd924-db25-411e-b66b-6c522e11729b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:08.510408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1249/2497] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:08.511224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc508d2-c432-4869-813f-b6353e35c33b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:08.524955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc508d2-c432-4869-813f-b6353e35c33b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:08.530341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f1f4f-5f41-46b4-a023-4e70a8a018f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:08.531152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f1f4f-5f41-46b4-a023-4e70a8a018f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:08.531468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f1f4f-5f41-46b4-a023-4e70a8a018f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:08.532032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f1f4f-5f41-46b4-a023-4e70a8a018f6 admin admin] PATH_INFO: `/v3/projects/aa49912426e5451bbbec6a6907ea73b2/users/54eecc3a8e054a0bbe0fd68e1aa85238/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:08.550472 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f1f4f-5f41-46b4-a023-4e70a8a018f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa49912426e5451bbbec6a6907ea73b2, user_id=54eecc3a8e054a0bbe0fd68e1aa85238, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:08.553683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f1f4f-5f41-46b4-a023-4e70a8a018f6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:08.569273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1249/2498] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:08 2022] PUT /identity/v3/projects/aa49912426e5451bbbec6a6907ea73b2/users/54eecc3a8e054a0bbe0fd68e1aa85238/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:46:08.575022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f4c1f-465a-4c8e-853b-2708005f4d60 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:08.575022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f4c1f-465a-4c8e-853b-2708005f4d60 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:08.575022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f4c1f-465a-4c8e-853b-2708005f4d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:08.597737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-896f4c1f-465a-4c8e-853b-2708005f4d60 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:08.599566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-896f4c1f-465a-4c8e-853b-2708005f4d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:08.655969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:08.677313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1250/2499] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:08.687677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f1f4f-5f41-46b4-a023-4e70a8a018f6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:08.689721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c33f1f4f-5f41-46b4-a023-4e70a8a018f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:08.762251 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f1f4f-5f41-46b4-a023-4e70a8a018f6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:08.766012 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d583fc2-47bd-4ae1-ba31-e94e5d307e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:08.766648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d583fc2-47bd-4ae1-ba31-e94e5d307e5b service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:08.766929 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d583fc2-47bd-4ae1-ba31-e94e5d307e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:08.767285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d583fc2-47bd-4ae1-ba31-e94e5d307e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:08.777197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d583fc2-47bd-4ae1-ba31-e94e5d307e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:08.778626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d583fc2-47bd-4ae1-ba31-e94e5d307e5b service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:08.789496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1250/2500] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:11.678797 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f4c1f-465a-4c8e-853b-2708005f4d60 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:11.680373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-896f4c1f-465a-4c8e-853b-2708005f4d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:11.706831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f4c1f-465a-4c8e-853b-2708005f4d60 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:11.729556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:11.730202 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:11.730484 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:11.730762 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:11.736090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:11.771706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:11.773190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:11.800831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1251/2501] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:16.497094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215230-ddb0-42ea-a348-c402d0217805 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:16.497698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215230-ddb0-42ea-a348-c402d0217805 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:16.497698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215230-ddb0-42ea-a348-c402d0217805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:16.561934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b4215230-ddb0-42ea-a348-c402d0217805 None None] MFA Rules not processed for user `54eecc3a8e054a0bbe0fd68e1aa85238`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:16.563565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b4215230-ddb0-42ea-a348-c402d0217805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:16.723816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1251/2502] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:16.742876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:16.746657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:16.889312 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323990d-a139-4450-a0c7-ce6493706336 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:16.895631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84fd79-9920-4eee-ba5a-f1d6945c4450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:16.897896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84fd79-9920-4eee-ba5a-f1d6945c4450 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:16.898612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84fd79-9920-4eee-ba5a-f1d6945c4450 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:16.898892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84fd79-9920-4eee-ba5a-f1d6945c4450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:16.911882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84fd79-9920-4eee-ba5a-f1d6945c4450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:16.915254 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84fd79-9920-4eee-ba5a-f1d6945c4450 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:16.931025 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1252/2503] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:17.715375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4215230-ddb0-42ea-a348-c402d0217805 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:17.717021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b4215230-ddb0-42ea-a348-c402d0217805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:17.741421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4215230-ddb0-42ea-a348-c402d0217805 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:17.751321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:17.752020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:17.752372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:17.752715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] PATH_INFO: `/v3/users/3264fa6c4cea48ba89955c9bb0c233ab` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:17.755669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3264fa6c4cea48ba89955c9bb0c233ab)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:17.757740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:17.823525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:17.835796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3264fa6c4cea48ba89955c9bb0c233ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:17.836841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3264fa6c4cea48ba89955c9bb0c233ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:17.858376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3264fa6c4cea48ba89955c9bb0c233ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:17.875194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3264fa6c4cea48ba89955c9bb0c233ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:17.900841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-f1c9c80b-ef28-4970-9044-df4742009699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3264fa6c4cea48ba89955c9bb0c233ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:17.919417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1252/2504] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:17 2022] DELETE /identity/v3/users/3264fa6c4cea48ba89955c9bb0c233ab => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:18.306714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84fd79-9920-4eee-ba5a-f1d6945c4450 service nova] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:18.331064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84fd79-9920-4eee-ba5a-f1d6945c4450 service nova] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:18.414708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:18.415531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:18.415904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:18.416371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] PATH_INFO: `/v3/projects/a3f526b3a2164c2e9efe858e70cd3a69` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:18.417846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f526b3a2164c2e9efe858e70cd3a69)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:18.420007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:18.480971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f526b3a2164c2e9efe858e70cd3a69', 'request_id': 'req-17492e2e-cbb1-428e-b460-443356f28ba8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:18.488693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f526b3a2164c2e9efe858e70cd3a69', 'request_id': 'req-17492e2e-cbb1-428e-b460-443356f28ba8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:18.493838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:18.500780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f526b3a2164c2e9efe858e70cd3a69', 'request_id': 'req-17492e2e-cbb1-428e-b460-443356f28ba8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:18.516840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] The token cache is being invalidate because project a3f526b3a2164c2e9efe858e70cd3a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:18.517483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:18.518318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-17492e2e-cbb1-428e-b460-443356f28ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:18.520099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1253/2505] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:18 2022] DELETE /identity/v3/projects/a3f526b3a2164c2e9efe858e70cd3a69 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:18.526588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578e0e-4341-4551-981d-07cba5675eb2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:18.527515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578e0e-4341-4551-981d-07cba5675eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:18.528189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578e0e-4341-4551-981d-07cba5675eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:18.562880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-8d578e0e-4341-4551-981d-07cba5675eb2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:18.564433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8d578e0e-4341-4551-981d-07cba5675eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:18.643062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1253/2506] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:18.654500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48776122-47a7-4261-b0e0-096c1de14471 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:18.666928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48776122-47a7-4261-b0e0-096c1de14471 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:18.667362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48776122-47a7-4261-b0e0-096c1de14471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:18.668017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efcf7f-1512-495b-b8dd-9864539b6479 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:18.668314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efcf7f-1512-495b-b8dd-9864539b6479 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:18.669256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efcf7f-1512-495b-b8dd-9864539b6479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:18.690485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c0efcf7f-1512-495b-b8dd-9864539b6479 None None] MFA Rules not processed for user `54eecc3a8e054a0bbe0fd68e1aa85238`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:18.690703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-48776122-47a7-4261-b0e0-096c1de14471 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:18.691773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c0efcf7f-1512-495b-b8dd-9864539b6479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:18.692185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-48776122-47a7-4261-b0e0-096c1de14471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:18.702567 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1254/2507] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:18.706737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48776122-47a7-4261-b0e0-096c1de14471 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:18.717696 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48776122-47a7-4261-b0e0-096c1de14471 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:18.724105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d716f-d184-4de8-9c12-2b890135998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:18.724795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d716f-d184-4de8-9c12-2b890135998a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:18.725077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d716f-d184-4de8-9c12-2b890135998a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:18.725348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d716f-d184-4de8-9c12-2b890135998a admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:18.726493 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d716f-d184-4de8-9c12-2b890135998a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:46:18.726798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d716f-d184-4de8-9c12-2b890135998a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:18.728926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d716f-d184-4de8-9c12-2b890135998a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:18.750954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1255/2508] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:46:18.757974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d716f-d184-4de8-9c12-2b890135998a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:18.766248 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d716f-d184-4de8-9c12-2b890135998a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:18.769969 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1254/2509] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:46:18.771748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa62af-970b-46b7-be34-d2ca213f7943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:18.772370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa62af-970b-46b7-be34-d2ca213f7943 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:18.772648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa62af-970b-46b7-be34-d2ca213f7943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:18.772920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa62af-970b-46b7-be34-d2ca213f7943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:18.773593 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa62af-970b-46b7-be34-d2ca213f7943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:18.775657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa62af-970b-46b7-be34-d2ca213f7943 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:18.815925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1256/2510] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:18 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:18.818338 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efcf7f-1512-495b-b8dd-9864539b6479 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:18.833152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efcf7f-1512-495b-b8dd-9864539b6479 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:18.918108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f959a-337b-4938-a24c-2cc0aca5c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:18.918822 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f959a-337b-4938-a24c-2cc0aca5c3ee admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:18.919209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f959a-337b-4938-a24c-2cc0aca5c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:18.919547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f959a-337b-4938-a24c-2cc0aca5c3ee admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:18.920320 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f959a-337b-4938-a24c-2cc0aca5c3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:18.922509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f959a-337b-4938-a24c-2cc0aca5c3ee admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:18.933270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:18.954144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1255/2511] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:18 2022] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:18.955173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa62af-970b-46b7-be34-d2ca213f7943 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:18.966477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa62af-970b-46b7-be34-d2ca213f7943 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:18.974766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c71d0-6573-455a-97af-7baaf270f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:18.975092 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c71d0-6573-455a-97af-7baaf270f136 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:18.976926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c71d0-6573-455a-97af-7baaf270f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:18.976926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c71d0-6573-455a-97af-7baaf270f136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:18.976926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c71d0-6573-455a-97af-7baaf270f136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:18.978364 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c71d0-6573-455a-97af-7baaf270f136 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:18.995049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1257/2512] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:46:19.000532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f959a-337b-4938-a24c-2cc0aca5c3ee admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:19.016391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f959a-337b-4938-a24c-2cc0aca5c3ee admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:19.025453 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb9c4a-89e1-4cb2-a4a0-a1cc3baee27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:19.026104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb9c4a-89e1-4cb2-a4a0-a1cc3baee27f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:19.026379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb9c4a-89e1-4cb2-a4a0-a1cc3baee27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:19.026648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb9c4a-89e1-4cb2-a4a0-a1cc3baee27f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:19.027447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb9c4a-89e1-4cb2-a4a0-a1cc3baee27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:19.029392 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb9c4a-89e1-4cb2-a4a0-a1cc3baee27f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:19.047268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1256/2513] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:19.051637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c71d0-6573-455a-97af-7baaf270f136 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:19.063020 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c71d0-6573-455a-97af-7baaf270f136 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:19.069524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e25136-323f-466f-b0e4-17ce987e2164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:19.070209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e25136-323f-466f-b0e4-17ce987e2164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:19.070489 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e25136-323f-466f-b0e4-17ce987e2164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:19.070764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e25136-323f-466f-b0e4-17ce987e2164 admin admin] PATH_INFO: `/v3/projects/3a4914504f9b4dc0b620d96370508d67/users/0b50256971574153b2fa3010ba49fd21/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:19.088834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e25136-323f-466f-b0e4-17ce987e2164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4914504f9b4dc0b620d96370508d67, user_id=0b50256971574153b2fa3010ba49fd21, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:19.091868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e25136-323f-466f-b0e4-17ce987e2164 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:19.113511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1258/2514] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:19 2022] PUT /identity/v3/projects/3a4914504f9b4dc0b620d96370508d67/users/0b50256971574153b2fa3010ba49fd21/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:19.115935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3df42-1381-449d-8499-901bb6f41805 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:19.116237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3df42-1381-449d-8499-901bb6f41805 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:19.117062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3df42-1381-449d-8499-901bb6f41805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:19.141408 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-14e3df42-1381-449d-8499-901bb6f41805 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:19.142772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-14e3df42-1381-449d-8499-901bb6f41805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:19.224528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1257/2515] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:46:19.234916 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e25136-323f-466f-b0e4-17ce987e2164 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:19.236689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a5e25136-323f-466f-b0e4-17ce987e2164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:19.322238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e25136-323f-466f-b0e4-17ce987e2164 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:19.333056 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a5d62-1c4c-445f-9a04-158641b8b870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:19.333765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a5d62-1c4c-445f-9a04-158641b8b870 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:19.334049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a5d62-1c4c-445f-9a04-158641b8b870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:19.334321 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a5d62-1c4c-445f-9a04-158641b8b870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:19.346355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a5d62-1c4c-445f-9a04-158641b8b870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:19.349088 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a5d62-1c4c-445f-9a04-158641b8b870 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:19.369660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1259/2516] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:20.230103 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d9a4-ce8d-488b-babb-c6ad7fa05223 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:20.230569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d9a4-ce8d-488b-babb-c6ad7fa05223 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:20.230772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d9a4-ce8d-488b-babb-c6ad7fa05223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:20.298704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6009d9a4-ce8d-488b-babb-c6ad7fa05223 None None] MFA Rules not processed for user `0b50256971574153b2fa3010ba49fd21`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:20.301170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6009d9a4-ce8d-488b-babb-c6ad7fa05223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:20.416797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1258/2517] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:20.417551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a5d62-1c4c-445f-9a04-158641b8b870 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:20.429360 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a5d62-1c4c-445f-9a04-158641b8b870 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:20.434605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19845c1-3e61-4d48-b0b1-be55efc90f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:20.435499 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19845c1-3e61-4d48-b0b1-be55efc90f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:20.435780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19845c1-3e61-4d48-b0b1-be55efc90f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:20.436054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19845c1-3e61-4d48-b0b1-be55efc90f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:20.436771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19845c1-3e61-4d48-b0b1-be55efc90f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:20.438867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19845c1-3e61-4d48-b0b1-be55efc90f91 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:20.481040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1260/2518] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:20 2022] POST /identity/v3/projects => generated 403 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:20.485487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d9a4-ce8d-488b-babb-c6ad7fa05223 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:20.499611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d9a4-ce8d-488b-babb-c6ad7fa05223 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:20.617325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b6f4-56cc-44d3-92cf-91e86f71cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:20.618230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b6f4-56cc-44d3-92cf-91e86f71cb9c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:20.618510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b6f4-56cc-44d3-92cf-91e86f71cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:20.618937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b6f4-56cc-44d3-92cf-91e86f71cb9c admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:20.619665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3b6f4-56cc-44d3-92cf-91e86f71cb9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:20.621690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3b6f4-56cc-44d3-92cf-91e86f71cb9c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:20.658641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1259/2519] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:20 2022] POST /identity/v3/users => generated 308 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:20.662709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19845c1-3e61-4d48-b0b1-be55efc90f91 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:20.674776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19845c1-3e61-4d48-b0b1-be55efc90f91 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:20.683774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d6e35-4606-44d3-b733-006e5ca4f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:20.684731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d6e35-4606-44d3-b733-006e5ca4f81a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:20.685177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d6e35-4606-44d3-b733-006e5ca4f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:20.685596 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d6e35-4606-44d3-b733-006e5ca4f81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:20.686553 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d6e35-4606-44d3-b733-006e5ca4f81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:20.688940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d6e35-4606-44d3-b733-006e5ca4f81a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:20.708983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b6f4-56cc-44d3-92cf-91e86f71cb9c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:20.709703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1261/2520] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:20.716350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:20.726544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b6f4-56cc-44d3-92cf-91e86f71cb9c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:20.755763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125962a7-4d4c-44fb-b330-b03f30e35a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:20.755763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125962a7-4d4c-44fb-b330-b03f30e35a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:20.755763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125962a7-4d4c-44fb-b330-b03f30e35a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:20.755763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125962a7-4d4c-44fb-b330-b03f30e35a28 admin admin] PATH_INFO: `/v3/projects/085ae6205dc84c4c97d0ed1211944844/users/bc6f67ac49dc4dc4b120c1f4d6e625b0/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:20.778215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125962a7-4d4c-44fb-b330-b03f30e35a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085ae6205dc84c4c97d0ed1211944844, user_id=bc6f67ac49dc4dc4b120c1f4d6e625b0, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:20.781219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125962a7-4d4c-44fb-b330-b03f30e35a28 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:20.810043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1260/2521] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:20 2022] PUT /identity/v3/projects/085ae6205dc84c4c97d0ed1211944844/users/bc6f67ac49dc4dc4b120c1f4d6e625b0/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:20.813937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d6e35-4606-44d3-b733-006e5ca4f81a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:20.827438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d6e35-4606-44d3-b733-006e5ca4f81a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:20.889990 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:20.897703 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125962a7-4d4c-44fb-b330-b03f30e35a28 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:20.900197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-125962a7-4d4c-44fb-b330-b03f30e35a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:20.914534 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5910be-e5f4-4e9e-b63a-84096db9f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:20.915251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5910be-e5f4-4e9e-b63a-84096db9f07c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:20.915537 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5910be-e5f4-4e9e-b63a-84096db9f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:20.915809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5910be-e5f4-4e9e-b63a-84096db9f07c admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:20.916508 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5910be-e5f4-4e9e-b63a-84096db9f07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:20.918371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5910be-e5f4-4e9e-b63a-84096db9f07c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:20.930582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1262/2522] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:20.934756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5910be-e5f4-4e9e-b63a-84096db9f07c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:20.946745 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5910be-e5f4-4e9e-b63a-84096db9f07c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:20.969517 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103d2d3-7ba2-4919-9d57-0b67d94bdf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:20.970366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103d2d3-7ba2-4919-9d57-0b67d94bdf0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:20.970654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103d2d3-7ba2-4919-9d57-0b67d94bdf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:20.970932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103d2d3-7ba2-4919-9d57-0b67d94bdf0d admin admin] PATH_INFO: `/v3/projects/085ae6205dc84c4c97d0ed1211944844/users/bc6f67ac49dc4dc4b120c1f4d6e625b0/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:20.973154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103d2d3-7ba2-4919-9d57-0b67d94bdf0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=085ae6205dc84c4c97d0ed1211944844, user_id=bc6f67ac49dc4dc4b120c1f4d6e625b0, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:20.975855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103d2d3-7ba2-4919-9d57-0b67d94bdf0d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:21.000892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1263/2523] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:20 2022] PUT /identity/v3/projects/085ae6205dc84c4c97d0ed1211944844/users/bc6f67ac49dc4dc4b120c1f4d6e625b0/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:46:21.088683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125962a7-4d4c-44fb-b330-b03f30e35a28 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:21.194903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a13bd-29f1-460d-9690-873a7a587411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:21.195725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a13bd-29f1-460d-9690-873a7a587411 service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:21.196106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a13bd-29f1-460d-9690-873a7a587411 service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:21.196489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a13bd-29f1-460d-9690-873a7a587411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:21.198675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e56a13bd-29f1-460d-9690-873a7a587411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:21.226406 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a13bd-29f1-460d-9690-873a7a587411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:21.228082 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a13bd-29f1-460d-9690-873a7a587411 service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:21.251642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1261/2524] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:22.480557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79404ddd-d2a0-4d18-ab87-bbe35c9ac463 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:22.481078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79404ddd-d2a0-4d18-ab87-bbe35c9ac463 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:22.481201 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79404ddd-d2a0-4d18-ab87-bbe35c9ac463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:22.522737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-79404ddd-d2a0-4d18-ab87-bbe35c9ac463 None None] MFA Rules not processed for user `bc6f67ac49dc4dc4b120c1f4d6e625b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:22.524337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-79404ddd-d2a0-4d18-ab87-bbe35c9ac463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:22.629038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1264/2525] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:22 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:23.294840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfbc94-9d56-49be-b1b6-d954e0a97b6c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:23.295729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfbc94-9d56-49be-b1b6-d954e0a97b6c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:23.296299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfbc94-9d56-49be-b1b6-d954e0a97b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:23.336189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c6dfbc94-9d56-49be-b1b6-d954e0a97b6c None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:23.338024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c6dfbc94-9d56-49be-b1b6-d954e0a97b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:23.409073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1262/2526] 10.222.0.57 () {58 vars in 967 bytes} [Thu Aug 4 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:23.443500 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79404ddd-d2a0-4d18-ab87-bbe35c9ac463 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:23.445934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-79404ddd-d2a0-4d18-ab87-bbe35c9ac463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:23.541792 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79404ddd-d2a0-4d18-ab87-bbe35c9ac463 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:23.551988 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c18f9-334a-472f-a68c-e8f89ff85d35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:23.552907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c18f9-334a-472f-a68c-e8f89ff85d35 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:23.553366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c18f9-334a-472f-a68c-e8f89ff85d35 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:23.553794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c18f9-334a-472f-a68c-e8f89ff85d35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:23.564191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c18f9-334a-472f-a68c-e8f89ff85d35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:23.566402 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c18f9-334a-472f-a68c-e8f89ff85d35 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:23.577460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1265/2527] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:46:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:46:24.202055 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfbc94-9d56-49be-b1b6-d954e0a97b6c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:24.211415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:24.268600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfbc94-9d56-49be-b1b6-d954e0a97b6c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:24.273126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:24.273765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:24.274054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:24.274329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] PATH_INFO: `/v3/users/0b50256971574153b2fa3010ba49fd21` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:24.275786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b50256971574153b2fa3010ba49fd21)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:24.277444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:24.325823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b50256971574153b2fa3010ba49fd21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.326470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b50256971574153b2fa3010ba49fd21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.339640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b50256971574153b2fa3010ba49fd21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.346456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b50256971574153b2fa3010ba49fd21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.354544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b50256971574153b2fa3010ba49fd21'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.360535 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1263/2528] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:24 2022] DELETE /identity/v3/users/0b50256971574153b2fa3010ba49fd21 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:24.540253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c18f9-334a-472f-a68c-e8f89ff85d35 service swift] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:24.551410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c18f9-334a-472f-a68c-e8f89ff85d35 service swift] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:24.594237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:24.611315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:24.611961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:24.612243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:24.612551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] PATH_INFO: `/v3/projects/3a4914504f9b4dc0b620d96370508d67` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:24.613715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4914504f9b4dc0b620d96370508d67)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:24.618552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:24.668694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4914504f9b4dc0b620d96370508d67', 'request_id': 'req-7ae3eaa8-e373-4f95-abab-aa01a3a66764'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.674897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4914504f9b4dc0b620d96370508d67', 'request_id': 'req-7ae3eaa8-e373-4f95-abab-aa01a3a66764'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.683013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4914504f9b4dc0b620d96370508d67', 'request_id': 'req-7ae3eaa8-e373-4f95-abab-aa01a3a66764'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.698158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] The token cache is being invalidate because project 3a4914504f9b4dc0b620d96370508d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:24.698486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.699466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.701767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1266/2529] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:24 2022] DELETE /identity/v3/projects/3a4914504f9b4dc0b620d96370508d67 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:24.711847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:24.715048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:24.756509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef59826-0529-493b-8d50-e0bf554a2575 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:24.875063 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:24.875640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:24.875941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:24.876267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] PATH_INFO: `/v3/users/bc6f67ac49dc4dc4b120c1f4d6e625b0` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:24.879167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6f67ac49dc4dc4b120c1f4d6e625b0)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:24.880284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:24.916357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:24.944665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6f67ac49dc4dc4b120c1f4d6e625b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.945351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6f67ac49dc4dc4b120c1f4d6e625b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.963267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6f67ac49dc4dc4b120c1f4d6e625b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.971431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6f67ac49dc4dc4b120c1f4d6e625b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.983570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-6d585348-7c11-4ceb-97cd-b46e792fae29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6f67ac49dc4dc4b120c1f4d6e625b0'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:24.995140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1264/2530] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:24 2022] DELETE /identity/v3/users/bc6f67ac49dc4dc4b120c1f4d6e625b0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:25.186141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:25.187746 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:25.209539 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3eaa8-e373-4f95-abab-aa01a3a66764 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:25.276749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:25.277395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.277675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.277944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] PATH_INFO: `/v3/projects/085ae6205dc84c4c97d0ed1211944844` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.279117 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=085ae6205dc84c4c97d0ed1211944844)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:25.281013 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:25.327842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085ae6205dc84c4c97d0ed1211944844', 'request_id': 'req-bcafcb2c-694c-450c-887e-db0e04ea69ac'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:25.333944 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085ae6205dc84c4c97d0ed1211944844', 'request_id': 'req-bcafcb2c-694c-450c-887e-db0e04ea69ac'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:25.341983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085ae6205dc84c4c97d0ed1211944844', 'request_id': 'req-bcafcb2c-694c-450c-887e-db0e04ea69ac'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:25.356548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] The token cache is being invalidate because project 085ae6205dc84c4c97d0ed1211944844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:25.356828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:25.357479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bcafcb2c-694c-450c-887e-db0e04ea69ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:25.359042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1267/2531] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:25 2022] DELETE /identity/v3/projects/085ae6205dc84c4c97d0ed1211944844 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:25.364045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df80080-a899-4051-850a-c7af72461d8f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.364519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df80080-a899-4051-850a-c7af72461d8f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.364636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df80080-a899-4051-850a-c7af72461d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.384643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9df80080-a899-4051-850a-c7af72461d8f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:25.385793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9df80080-a899-4051-850a-c7af72461d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:25.447158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1265/2532] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:25.456161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981e945-6cbd-426e-9140-0effee14cd17 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.456161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981e945-6cbd-426e-9140-0effee14cd17 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.457605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981e945-6cbd-426e-9140-0effee14cd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.465649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:25.487385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b981e945-6cbd-426e-9140-0effee14cd17 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:25.488590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b981e945-6cbd-426e-9140-0effee14cd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:25.496875 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1268/2533] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:25.501189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df80080-a899-4051-850a-c7af72461d8f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:25.511629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df80080-a899-4051-850a-c7af72461d8f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:25.516500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060b934-e349-4b32-99af-a1775ae3bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:25.517118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060b934-e349-4b32-99af-a1775ae3bd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.518665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060b934-e349-4b32-99af-a1775ae3bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.518665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060b934-e349-4b32-99af-a1775ae3bd6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.518665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060b934-e349-4b32-99af-a1775ae3bd6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:46:25.518665 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060b934-e349-4b32-99af-a1775ae3bd6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:25.520881 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060b934-e349-4b32-99af-a1775ae3bd6e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:25.538771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1266/2534] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:46:25.540288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981e945-6cbd-426e-9140-0effee14cd17 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:25.549945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981e945-6cbd-426e-9140-0effee14cd17 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:25.554698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6def2-9805-4588-b653-f54caccda791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:25.555356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6def2-9805-4588-b653-f54caccda791 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.555638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6def2-9805-4588-b653-f54caccda791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.555911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6def2-9805-4588-b653-f54caccda791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.556611 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6def2-9805-4588-b653-f54caccda791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:25.558504 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6def2-9805-4588-b653-f54caccda791 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:25.590479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1269/2535] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:25 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:25.594744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060b934-e349-4b32-99af-a1775ae3bd6e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:25.604938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060b934-e349-4b32-99af-a1775ae3bd6e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:25.662021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2e40e-2548-487f-a995-08c9c5ea42c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:25.662547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2e40e-2548-487f-a995-08c9c5ea42c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.662828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2e40e-2548-487f-a995-08c9c5ea42c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.663132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2e40e-2548-487f-a995-08c9c5ea42c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.663838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2e40e-2548-487f-a995-08c9c5ea42c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:25.665752 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2e40e-2548-487f-a995-08c9c5ea42c9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:25.687736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1267/2536] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:25 2022] POST /identity/v3/users => generated 278 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:25.692388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6def2-9805-4588-b653-f54caccda791 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:25.702674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6def2-9805-4588-b653-f54caccda791 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:25.707639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84846405-5d40-4e58-a0b5-30a2d27aa739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:25.708254 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84846405-5d40-4e58-a0b5-30a2d27aa739 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.708533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84846405-5d40-4e58-a0b5-30a2d27aa739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.708827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84846405-5d40-4e58-a0b5-30a2d27aa739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.709598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84846405-5d40-4e58-a0b5-30a2d27aa739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:25.711480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84846405-5d40-4e58-a0b5-30a2d27aa739 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:25.721836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1270/2537] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:25.725916 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2e40e-2548-487f-a995-08c9c5ea42c9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:25.736014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2e40e-2548-487f-a995-08c9c5ea42c9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:25.741112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c278d32-5cb9-47ee-93ed-e4d97c22d9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:25.741722 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c278d32-5cb9-47ee-93ed-e4d97c22d9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.741994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c278d32-5cb9-47ee-93ed-e4d97c22d9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.742263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c278d32-5cb9-47ee-93ed-e4d97c22d9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.743003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c278d32-5cb9-47ee-93ed-e4d97c22d9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:25.744603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c278d32-5cb9-47ee-93ed-e4d97c22d9d4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:25.765363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1268/2538] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:25.769794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84846405-5d40-4e58-a0b5-30a2d27aa739 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:25.780416 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84846405-5d40-4e58-a0b5-30a2d27aa739 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:25.785531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e839ab3-3cbc-473b-ad68-07af47e71a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:25.786199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e839ab3-3cbc-473b-ad68-07af47e71a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.786511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e839ab3-3cbc-473b-ad68-07af47e71a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.786785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e839ab3-3cbc-473b-ad68-07af47e71a2a admin admin] PATH_INFO: `/v3/projects/073ce2ec59374e27a8ef05e41d9cbfee/users/13a06015ecba4ec2a880c63c8fe14543/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.802478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e839ab3-3cbc-473b-ad68-07af47e71a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=073ce2ec59374e27a8ef05e41d9cbfee, user_id=13a06015ecba4ec2a880c63c8fe14543, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:25.805127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e839ab3-3cbc-473b-ad68-07af47e71a2a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:25.819460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1271/2539] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:25 2022] PUT /identity/v3/projects/073ce2ec59374e27a8ef05e41d9cbfee/users/13a06015ecba4ec2a880c63c8fe14543/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:46:25.831247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97613-fd01-4e48-9e4b-feada3ccc583 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:25.831535 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97613-fd01-4e48-9e4b-feada3ccc583 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:25.831809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a97613-fd01-4e48-9e4b-feada3ccc583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:25.851701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:25.860111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-35a97613-fd01-4e48-9e4b-feada3ccc583 None None] MFA Rules not processed for user `13a06015ecba4ec2a880c63c8fe14543`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:25.861844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-35a97613-fd01-4e48-9e4b-feada3ccc583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:25.929108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1269/2540] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:25.933577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e839ab3-3cbc-473b-ad68-07af47e71a2a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:25.996882 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e839ab3-3cbc-473b-ad68-07af47e71a2a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:26.001572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5908-6177-4c31-8595-77474c878d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:26.002184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5908-6177-4c31-8595-77474c878d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:26.002465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5908-6177-4c31-8595-77474c878d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:26.002774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5908-6177-4c31-8595-77474c878d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:26.003543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5908-6177-4c31-8595-77474c878d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:26.005436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5908-6177-4c31-8595-77474c878d52 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:26.039645 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1272/2541] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:25 2022] POST /identity/v3/projects => generated 357 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:26.040842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97613-fd01-4e48-9e4b-feada3ccc583 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:26.053268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a97613-fd01-4e48-9e4b-feada3ccc583 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:26.118614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e95de-bad7-4144-90f3-b3f1b2e80951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:26.119310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e95de-bad7-4144-90f3-b3f1b2e80951 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:26.119591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e95de-bad7-4144-90f3-b3f1b2e80951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:26.119857 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e95de-bad7-4144-90f3-b3f1b2e80951 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:26.120546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e95de-bad7-4144-90f3-b3f1b2e80951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:26.122532 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e95de-bad7-4144-90f3-b3f1b2e80951 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:26.146750 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1270/2542] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:26 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:26.150931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5908-6177-4c31-8595-77474c878d52 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:26.165326 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5908-6177-4c31-8595-77474c878d52 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:26.170543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d879da6-a610-4c61-948d-32a1921454d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:26.171191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d879da6-a610-4c61-948d-32a1921454d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:26.171468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d879da6-a610-4c61-948d-32a1921454d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:26.171733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d879da6-a610-4c61-948d-32a1921454d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:26.172425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d879da6-a610-4c61-948d-32a1921454d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:26.174006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d879da6-a610-4c61-948d-32a1921454d2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:26.189876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1273/2543] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:46:26.190337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e95de-bad7-4144-90f3-b3f1b2e80951 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:26.203543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e95de-bad7-4144-90f3-b3f1b2e80951 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:26.208548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0349fa-dcc3-4f30-9d39-e6e98c42c3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:26.209309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0349fa-dcc3-4f30-9d39-e6e98c42c3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:26.209672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0349fa-dcc3-4f30-9d39-e6e98c42c3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:26.210007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0349fa-dcc3-4f30-9d39-e6e98c42c3ea admin admin] PATH_INFO: `/v3/projects/48ffc18400ed48f09482f03006ddc1d1/users/d4d460a82e5f459c9f7cff66e6728692/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:26.231108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0349fa-dcc3-4f30-9d39-e6e98c42c3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ffc18400ed48f09482f03006ddc1d1, user_id=d4d460a82e5f459c9f7cff66e6728692, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:26.233920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0349fa-dcc3-4f30-9d39-e6e98c42c3ea admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:26.257689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1271/2544] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:26 2022] PUT /identity/v3/projects/48ffc18400ed48f09482f03006ddc1d1/users/d4d460a82e5f459c9f7cff66e6728692/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:26.262564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d879da6-a610-4c61-948d-32a1921454d2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:26.275751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d879da6-a610-4c61-948d-32a1921454d2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:26.343170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c5bae-dc18-4dce-8009-2ad69d333232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:26.344206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c5bae-dc18-4dce-8009-2ad69d333232 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:26.344689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c5bae-dc18-4dce-8009-2ad69d333232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:26.345169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c5bae-dc18-4dce-8009-2ad69d333232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:26.346142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c5bae-dc18-4dce-8009-2ad69d333232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:26.348376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c5bae-dc18-4dce-8009-2ad69d333232 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:26.359021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1274/2545] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:26.363337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0349fa-dcc3-4f30-9d39-e6e98c42c3ea admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:26.374049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0349fa-dcc3-4f30-9d39-e6e98c42c3ea admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:26.378835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14f93-4fcb-4793-a95a-ddc04dd0af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:26.379550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14f93-4fcb-4793-a95a-ddc04dd0af6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:26.379869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14f93-4fcb-4793-a95a-ddc04dd0af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:26.380147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14f93-4fcb-4793-a95a-ddc04dd0af6a admin admin] PATH_INFO: `/v3/projects/48ffc18400ed48f09482f03006ddc1d1/users/d4d460a82e5f459c9f7cff66e6728692/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:26.382198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac14f93-4fcb-4793-a95a-ddc04dd0af6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ffc18400ed48f09482f03006ddc1d1, user_id=d4d460a82e5f459c9f7cff66e6728692, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:26.384889 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac14f93-4fcb-4793-a95a-ddc04dd0af6a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:26.397060 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1272/2546] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:26 2022] PUT /identity/v3/projects/48ffc18400ed48f09482f03006ddc1d1/users/d4d460a82e5f459c9f7cff66e6728692/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:26.407397 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b40c6b-7a58-4cda-ab2e-9081a91931a4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:26.407689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b40c6b-7a58-4cda-ab2e-9081a91931a4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:26.407969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b40c6b-7a58-4cda-ab2e-9081a91931a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:26.428751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:26.440124 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a7b40c6b-7a58-4cda-ab2e-9081a91931a4 None None] MFA Rules not processed for user `d4d460a82e5f459c9f7cff66e6728692`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:26.441445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a7b40c6b-7a58-4cda-ab2e-9081a91931a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:26.536705 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1275/2547] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:26.548967 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14f93-4fcb-4793-a95a-ddc04dd0af6a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:26.550747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-bac14f93-4fcb-4793-a95a-ddc04dd0af6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:26.607749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14f93-4fcb-4793-a95a-ddc04dd0af6a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:26.611357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340767b-112e-487f-9eda-3127f159ec82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:26.611963 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340767b-112e-487f-9eda-3127f159ec82 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:26.612240 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340767b-112e-487f-9eda-3127f159ec82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:26.613041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340767b-112e-487f-9eda-3127f159ec82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:26.619943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:26.622199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340767b-112e-487f-9eda-3127f159ec82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:26.624191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340767b-112e-487f-9eda-3127f159ec82 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:26.635165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1273/2548] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:26.713510 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b40c6b-7a58-4cda-ab2e-9081a91931a4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:26.724277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b40c6b-7a58-4cda-ab2e-9081a91931a4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:26.728337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714c7e2-bf68-41b4-84d8-d682f549f420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:26.729077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714c7e2-bf68-41b4-84d8-d682f549f420 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:26.729454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714c7e2-bf68-41b4-84d8-d682f549f420 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:26.729825 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714c7e2-bf68-41b4-84d8-d682f549f420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:26.793191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714c7e2-bf68-41b4-84d8-d682f549f420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:26.795941 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714c7e2-bf68-41b4-84d8-d682f549f420 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:26.809586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1276/2549] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:32.188112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340767b-112e-487f-9eda-3127f159ec82 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:32.189637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a340767b-112e-487f-9eda-3127f159ec82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:32.288681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340767b-112e-487f-9eda-3127f159ec82 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:32.295207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543f19-86c5-4273-a04f-35f47109835f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:32.295924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543f19-86c5-4273-a04f-35f47109835f service nova] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:32.296272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543f19-86c5-4273-a04f-35f47109835f service nova] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:32.296550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543f19-86c5-4273-a04f-35f47109835f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:32.298627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e3543f19-86c5-4273-a04f-35f47109835f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:32.312834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543f19-86c5-4273-a04f-35f47109835f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:32.314413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543f19-86c5-4273-a04f-35f47109835f service nova] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:32.328115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1274/2550] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:46:36.803680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=58 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:42.056949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714c7e2-bf68-41b4-84d8-d682f549f420 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:42.122329 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714c7e2-bf68-41b4-84d8-d682f549f420 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:42.126812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:42.128019 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:42.128429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:42.128727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] PATH_INFO: `/v3/users/13a06015ecba4ec2a880c63c8fe14543` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:42.129877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a06015ecba4ec2a880c63c8fe14543)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:42.131872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:42.187620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a06015ecba4ec2a880c63c8fe14543'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.188471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a06015ecba4ec2a880c63c8fe14543'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.202922 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a06015ecba4ec2a880c63c8fe14543'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.210815 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a06015ecba4ec2a880c63c8fe14543'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.211469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a06015ecba4ec2a880c63c8fe14543'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.224680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1277/2551] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:42 2022] DELETE /identity/v3/users/13a06015ecba4ec2a880c63c8fe14543 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:42.231834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a7a82-336c-4d77-864d-9363ce59f416 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:42.233379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a7a82-336c-4d77-864d-9363ce59f416 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:42.233715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a7a82-336c-4d77-864d-9363ce59f416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:42.253844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-356a7a82-336c-4d77-864d-9363ce59f416 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:42.255115 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-356a7a82-336c-4d77-864d-9363ce59f416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:42.313900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1275/2552] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:42.324334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:42.325894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:42.400711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdb6b1-3424-4a4a-bdd5-440e23a8e42c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:42.404964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ba91-fde9-4e76-96f6-141fd1e1fa32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:42.405651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ba91-fde9-4e76-96f6-141fd1e1fa32 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:42.405874 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ba91-fde9-4e76-96f6-141fd1e1fa32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:42.406295 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ba91-fde9-4e76-96f6-141fd1e1fa32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:42.416454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ba91-fde9-4e76-96f6-141fd1e1fa32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:42.417891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ba91-fde9-4e76-96f6-141fd1e1fa32 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:42.429617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1278/2553] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:42.810817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a7a82-336c-4d77-864d-9363ce59f416 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:42.812592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-356a7a82-336c-4d77-864d-9363ce59f416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:42.838827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a7a82-336c-4d77-864d-9363ce59f416 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:42.845814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:42.849376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:42.849661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:42.849949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] PATH_INFO: `/v3/projects/073ce2ec59374e27a8ef05e41d9cbfee` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:42.851920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073ce2ec59374e27a8ef05e41d9cbfee)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:42.862040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:42.918317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073ce2ec59374e27a8ef05e41d9cbfee', 'request_id': 'req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.924028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073ce2ec59374e27a8ef05e41d9cbfee', 'request_id': 'req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.931631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073ce2ec59374e27a8ef05e41d9cbfee', 'request_id': 'req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.943659 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] The token cache is being invalidate because project 073ce2ec59374e27a8ef05e41d9cbfee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:42.944061 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.944723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:42.946335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1276/2554] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:42 2022] DELETE /identity/v3/projects/073ce2ec59374e27a8ef05e41d9cbfee => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:42.950659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ba91-fde9-4e76-96f6-141fd1e1fa32 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:42.960909 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ba91-fde9-4e76-96f6-141fd1e1fa32 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:42.980310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:43.023083 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:43.023729 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:43.024026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:43.024285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] PATH_INFO: `/v3/users/d4d460a82e5f459c9f7cff66e6728692` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:43.025653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d460a82e5f459c9f7cff66e6728692)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:43.027669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:43.085333 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d460a82e5f459c9f7cff66e6728692'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.086096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d460a82e5f459c9f7cff66e6728692'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.100612 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d460a82e5f459c9f7cff66e6728692'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.111379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d460a82e5f459c9f7cff66e6728692'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.112069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-90fc2db4-bf97-4de5-b5fe-7010771986d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d460a82e5f459c9f7cff66e6728692'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.127999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1279/2555] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:42 2022] DELETE /identity/v3/users/d4d460a82e5f459c9f7cff66e6728692 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:43.477088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:43.478642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:43.493284 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:43.500778 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db9927-09b4-4da8-91f5-8c22fcbfd6a2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:43.581165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:43.581823 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:43.582129 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:43.582401 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] PATH_INFO: `/v3/projects/48ffc18400ed48f09482f03006ddc1d1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:43.583598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ffc18400ed48f09482f03006ddc1d1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:43.586304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:43.636777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ffc18400ed48f09482f03006ddc1d1', 'request_id': 'req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.642270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ffc18400ed48f09482f03006ddc1d1', 'request_id': 'req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.650058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ffc18400ed48f09482f03006ddc1d1', 'request_id': 'req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.662285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] The token cache is being invalidate because project 48ffc18400ed48f09482f03006ddc1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:43.662581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.663305 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-832f5d7c-35aa-4688-96e3-37ddf6d4f78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:43.665080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1277/2556] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:43 2022] DELETE /identity/v3/projects/48ffc18400ed48f09482f03006ddc1d1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:43.670089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686370c6-1345-4448-b3c7-3b1c29ea0174 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:43.670353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686370c6-1345-4448-b3c7-3b1c29ea0174 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:43.670579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686370c6-1345-4448-b3c7-3b1c29ea0174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:43.691674 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-686370c6-1345-4448-b3c7-3b1c29ea0174 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:43.692879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-686370c6-1345-4448-b3c7-3b1c29ea0174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:43.778957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1280/2557] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:43.781691 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d066a-ba8e-4a4f-8c66-150117025221 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:43.782009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d066a-ba8e-4a4f-8c66-150117025221 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:43.782361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d066a-ba8e-4a4f-8c66-150117025221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:43.806519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-754d066a-ba8e-4a4f-8c66-150117025221 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:43.807799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-754d066a-ba8e-4a4f-8c66-150117025221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:43.818038 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1278/2558] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:43.822145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686370c6-1345-4448-b3c7-3b1c29ea0174 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:43.832448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686370c6-1345-4448-b3c7-3b1c29ea0174 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:43.837196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d71179-fd52-41a2-a464-1dfa12f79028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:43.837821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d71179-fd52-41a2-a464-1dfa12f79028 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:43.838117 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d71179-fd52-41a2-a464-1dfa12f79028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:43.838385 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d71179-fd52-41a2-a464-1dfa12f79028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:43.839107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d71179-fd52-41a2-a464-1dfa12f79028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:46:43.839409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d71179-fd52-41a2-a464-1dfa12f79028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:43.841006 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d71179-fd52-41a2-a464-1dfa12f79028 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:43.854765 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1281/2559] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:46:43.859488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d066a-ba8e-4a4f-8c66-150117025221 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:43.870458 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d066a-ba8e-4a4f-8c66-150117025221 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:43.876142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfdcc5-c8eb-43fe-adf2-af05a37a266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:43.876801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfdcc5-c8eb-43fe-adf2-af05a37a266d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:43.877702 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfdcc5-c8eb-43fe-adf2-af05a37a266d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:43.878153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfdcc5-c8eb-43fe-adf2-af05a37a266d admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:43.878821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfdcc5-c8eb-43fe-adf2-af05a37a266d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:43.880733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfdcc5-c8eb-43fe-adf2-af05a37a266d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:43.910510 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1279/2560] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:43 2022] POST /identity/v3/projects => generated 409 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:43.914911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d71179-fd52-41a2-a464-1dfa12f79028 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:43.925380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d71179-fd52-41a2-a464-1dfa12f79028 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:43.951671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:43.984980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584155-7c87-48ac-9315-aeebebbd28d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:43.985629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584155-7c87-48ac-9315-aeebebbd28d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:43.985919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584155-7c87-48ac-9315-aeebebbd28d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:43.986180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584155-7c87-48ac-9315-aeebebbd28d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:43.987482 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584155-7c87-48ac-9315-aeebebbd28d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:43.989396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584155-7c87-48ac-9315-aeebebbd28d3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.011310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1282/2561] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:43 2022] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:44.015470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfdcc5-c8eb-43fe-adf2-af05a37a266d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.025940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfdcc5-c8eb-43fe-adf2-af05a37a266d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.031132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd9660-b08f-4c59-bc21-f7efc4fd765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.031757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd9660-b08f-4c59-bc21-f7efc4fd765f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.032037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd9660-b08f-4c59-bc21-f7efc4fd765f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.032330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd9660-b08f-4c59-bc21-f7efc4fd765f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.033028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd9660-b08f-4c59-bc21-f7efc4fd765f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.035713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd9660-b08f-4c59-bc21-f7efc4fd765f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.046014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1280/2562] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:44.050611 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584155-7c87-48ac-9315-aeebebbd28d3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.060732 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584155-7c87-48ac-9315-aeebebbd28d3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.065302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0060b2e-f581-4676-9045-42cc1b20ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.065901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060b2e-f581-4676-9045-42cc1b20ba99 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.066180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060b2e-f581-4676-9045-42cc1b20ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.066450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060b2e-f581-4676-9045-42cc1b20ba99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.067169 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0060b2e-f581-4676-9045-42cc1b20ba99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.068756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0060b2e-f581-4676-9045-42cc1b20ba99 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.079195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1283/2563] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:44.083268 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd9660-b08f-4c59-bc21-f7efc4fd765f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.093854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd9660-b08f-4c59-bc21-f7efc4fd765f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.099432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1031be1-a1e2-40a4-9e4f-9510224674c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.100126 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1031be1-a1e2-40a4-9e4f-9510224674c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.100409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1031be1-a1e2-40a4-9e4f-9510224674c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.100688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1031be1-a1e2-40a4-9e4f-9510224674c8 admin admin] PATH_INFO: `/v3/projects/e49d4eb3beaf406087a42c7228bf4ae9/users/2e456452d2064812bd0a2e32ef9e3453/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.116756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1031be1-a1e2-40a4-9e4f-9510224674c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49d4eb3beaf406087a42c7228bf4ae9, user_id=2e456452d2064812bd0a2e32ef9e3453, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.119452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1031be1-a1e2-40a4-9e4f-9510224674c8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.132088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1281/2564] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:44 2022] PUT /identity/v3/projects/e49d4eb3beaf406087a42c7228bf4ae9/users/2e456452d2064812bd0a2e32ef9e3453/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:44.143533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d9fb-b237-4712-a850-a0bb33ea3e21 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.144036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d9fb-b237-4712-a850-a0bb33ea3e21 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.144141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d9fb-b237-4712-a850-a0bb33ea3e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.171655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f904d9fb-b237-4712-a850-a0bb33ea3e21 None None] MFA Rules not processed for user `2e456452d2064812bd0a2e32ef9e3453`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:44.172851 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f904d9fb-b237-4712-a850-a0bb33ea3e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:44.236298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1284/2565] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:44 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:46:44.241329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1031be1-a1e2-40a4-9e4f-9510224674c8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.274805 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:44.306549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1031be1-a1e2-40a4-9e4f-9510224674c8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.311165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a08ce-5e0b-47d7-bed2-72bbcf6700c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.311774 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a08ce-5e0b-47d7-bed2-72bbcf6700c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.312051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a08ce-5e0b-47d7-bed2-72bbcf6700c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.312316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a08ce-5e0b-47d7-bed2-72bbcf6700c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.312973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a08ce-5e0b-47d7-bed2-72bbcf6700c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.315466 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a08ce-5e0b-47d7-bed2-72bbcf6700c6 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.341739 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1282/2566] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:44 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:44.345927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d9fb-b237-4712-a850-a0bb33ea3e21 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.356361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d9fb-b237-4712-a850-a0bb33ea3e21 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.416410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df4654-bb39-423c-9e35-529e8ee44124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.417017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df4654-bb39-423c-9e35-529e8ee44124 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.417290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df4654-bb39-423c-9e35-529e8ee44124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.417558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df4654-bb39-423c-9e35-529e8ee44124 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.418222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df4654-bb39-423c-9e35-529e8ee44124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.420119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df4654-bb39-423c-9e35-529e8ee44124 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.448078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1285/2567] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:44 2022] POST /identity/v3/users => generated 310 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:44.449548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a08ce-5e0b-47d7-bed2-72bbcf6700c6 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.459860 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a08ce-5e0b-47d7-bed2-72bbcf6700c6 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.464546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a813f-94f8-47d8-b7d5-87fccb2568ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.465173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a813f-94f8-47d8-b7d5-87fccb2568ac admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.465440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a813f-94f8-47d8-b7d5-87fccb2568ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.465711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a813f-94f8-47d8-b7d5-87fccb2568ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.466402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a813f-94f8-47d8-b7d5-87fccb2568ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.468057 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a813f-94f8-47d8-b7d5-87fccb2568ac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.479021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1283/2568] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:46:44.483998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df4654-bb39-423c-9e35-529e8ee44124 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.494847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df4654-bb39-423c-9e35-529e8ee44124 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.499631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a9533-a5ab-4ba1-9336-17f44d963a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.500303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a9533-a5ab-4ba1-9336-17f44d963a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.500581 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a9533-a5ab-4ba1-9336-17f44d963a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.500850 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a9533-a5ab-4ba1-9336-17f44d963a48 admin admin] PATH_INFO: `/v3/projects/848725961dda4fcdb30026e4ae60079f/users/80fa064656b24ef6b65848d8607ba18f/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.516796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a9533-a5ab-4ba1-9336-17f44d963a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848725961dda4fcdb30026e4ae60079f, user_id=80fa064656b24ef6b65848d8607ba18f, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.519556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a9533-a5ab-4ba1-9336-17f44d963a48 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.537421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1286/2569] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:44 2022] PUT /identity/v3/projects/848725961dda4fcdb30026e4ae60079f/users/80fa064656b24ef6b65848d8607ba18f/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:46:44.542092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a813f-94f8-47d8-b7d5-87fccb2568ac admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.556661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a813f-94f8-47d8-b7d5-87fccb2568ac admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.625123 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a9533-a5ab-4ba1-9336-17f44d963a48 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.626952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-503a9533-a5ab-4ba1-9336-17f44d963a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:44.633638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:44.642355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063619f-6769-4dbe-821e-2148b8dcf445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.643029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063619f-6769-4dbe-821e-2148b8dcf445 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.643312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063619f-6769-4dbe-821e-2148b8dcf445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.643584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063619f-6769-4dbe-821e-2148b8dcf445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.644281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063619f-6769-4dbe-821e-2148b8dcf445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.645888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063619f-6769-4dbe-821e-2148b8dcf445 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.656986 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1284/2570] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:44.661432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063619f-6769-4dbe-821e-2148b8dcf445 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.671415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063619f-6769-4dbe-821e-2148b8dcf445 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.676633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ca1ce-f1d2-42c4-a560-0decba2bf69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.677290 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ca1ce-f1d2-42c4-a560-0decba2bf69d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.677571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ca1ce-f1d2-42c4-a560-0decba2bf69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.677845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ca1ce-f1d2-42c4-a560-0decba2bf69d admin admin] PATH_INFO: `/v3/projects/848725961dda4fcdb30026e4ae60079f/users/80fa064656b24ef6b65848d8607ba18f/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.679854 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ca1ce-f1d2-42c4-a560-0decba2bf69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=848725961dda4fcdb30026e4ae60079f, user_id=80fa064656b24ef6b65848d8607ba18f, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.682494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ca1ce-f1d2-42c4-a560-0decba2bf69d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.690344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a9533-a5ab-4ba1-9336-17f44d963a48 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.693416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1285/2571] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:44 2022] PUT /identity/v3/projects/848725961dda4fcdb30026e4ae60079f/users/80fa064656b24ef6b65848d8607ba18f/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:46:44.703456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8778aa2-fdf9-4e9c-9903-d747af1294e4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.703746 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8778aa2-fdf9-4e9c-9903-d747af1294e4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.704027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8778aa2-fdf9-4e9c-9903-d747af1294e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.736438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f8778aa2-fdf9-4e9c-9903-d747af1294e4 None None] MFA Rules not processed for user `80fa064656b24ef6b65848d8607ba18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:44.736438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8778aa2-fdf9-4e9c-9903-d747af1294e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:44.747693 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73f5c-ad6d-4f4a-9fea-86c1beb47283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.748587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73f5c-ad6d-4f4a-9fea-86c1beb47283 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.748867 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73f5c-ad6d-4f4a-9fea-86c1beb47283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.749138 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73f5c-ad6d-4f4a-9fea-86c1beb47283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.750940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3ce73f5c-ad6d-4f4a-9fea-86c1beb47283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:44.807688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1286/2572] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:44 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:46:44.818569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8778aa2-fdf9-4e9c-9903-d747af1294e4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:44.820157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f8778aa2-fdf9-4e9c-9903-d747af1294e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:44.820638 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73f5c-ad6d-4f4a-9fea-86c1beb47283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.822090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73f5c-ad6d-4f4a-9fea-86c1beb47283 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.832526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1287/2573] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:46:44.835634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:44.886804 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8778aa2-fdf9-4e9c-9903-d747af1294e4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:44.890766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfba561-c2ec-4979-9283-7a9d483e863f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:44.891547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfba561-c2ec-4979-9283-7a9d483e863f service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:44.891900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfba561-c2ec-4979-9283-7a9d483e863f service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:44.892241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfba561-c2ec-4979-9283-7a9d483e863f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:44.903112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfba561-c2ec-4979-9283-7a9d483e863f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:44.904601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfba561-c2ec-4979-9283-7a9d483e863f service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:44.916529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1287/2574] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:44 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:46:45.087965 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73f5c-ad6d-4f4a-9fea-86c1beb47283 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:45.098794 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73f5c-ad6d-4f4a-9fea-86c1beb47283 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:45.102438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb6c1f-0892-4c1a-b93e-4578fc316b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:45.103214 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb6c1f-0892-4c1a-b93e-4578fc316b13 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:45.103501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb6c1f-0892-4c1a-b93e-4578fc316b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:45.103770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb6c1f-0892-4c1a-b93e-4578fc316b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:45.187511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb6c1f-0892-4c1a-b93e-4578fc316b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:45.189093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb6c1f-0892-4c1a-b93e-4578fc316b13 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:45.199546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1288/2575] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:45 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:50.838783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfba561-c2ec-4979-9283-7a9d483e863f service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:50.849953 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfba561-c2ec-4979-9283-7a9d483e863f service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:50.854574 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:50.855252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:50.855518 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:50.855825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] PATH_INFO: `/v3/users/2e456452d2064812bd0a2e32ef9e3453` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:50.856959 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e456452d2064812bd0a2e32ef9e3453)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:50.858888 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:50.909465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e456452d2064812bd0a2e32ef9e3453'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:50.910117 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e456452d2064812bd0a2e32ef9e3453'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:50.923324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e456452d2064812bd0a2e32ef9e3453'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:50.934895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e456452d2064812bd0a2e32ef9e3453'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:50.943958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e456452d2064812bd0a2e32ef9e3453'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:50.950236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1288/2576] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:50 2022] DELETE /identity/v3/users/2e456452d2064812bd0a2e32ef9e3453 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:50.954646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c86e17-82ec-4e01-ad7a-ed161a8f91b7 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:50.955204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c86e17-82ec-4e01-ad7a-ed161a8f91b7 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:50.955204 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c86e17-82ec-4e01-ad7a-ed161a8f91b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:50.977199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:50.984072 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-78c86e17-82ec-4e01-ad7a-ed161a8f91b7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:50.985433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-78c86e17-82ec-4e01-ad7a-ed161a8f91b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:51.062739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1289/2577] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:51.074311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:51.077027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:51.146450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074ef12-db33-45fb-902a-2ac432079b01 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:51.152316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc43d24-20d7-4b4a-8d1c-026862cab6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:51.153303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc43d24-20d7-4b4a-8d1c-026862cab6cf service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:51.153777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc43d24-20d7-4b4a-8d1c-026862cab6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:51.154257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc43d24-20d7-4b4a-8d1c-026862cab6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:51.169614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc43d24-20d7-4b4a-8d1c-026862cab6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:51.171146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc43d24-20d7-4b4a-8d1c-026862cab6cf service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:51.181292 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1289/2578] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:51.515548 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c86e17-82ec-4e01-ad7a-ed161a8f91b7 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:51.518251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-78c86e17-82ec-4e01-ad7a-ed161a8f91b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:51.541921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c86e17-82ec-4e01-ad7a-ed161a8f91b7 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:51.555930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:51.557937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:51.558230 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:51.558741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] PATH_INFO: `/v3/projects/e49d4eb3beaf406087a42c7228bf4ae9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:51.559971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49d4eb3beaf406087a42c7228bf4ae9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:51.564921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:51.638644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49d4eb3beaf406087a42c7228bf4ae9', 'request_id': 'req-023b2913-1a3f-4581-b14b-686849072c72'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.646263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49d4eb3beaf406087a42c7228bf4ae9', 'request_id': 'req-023b2913-1a3f-4581-b14b-686849072c72'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.657496 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49d4eb3beaf406087a42c7228bf4ae9', 'request_id': 'req-023b2913-1a3f-4581-b14b-686849072c72'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.675738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] The token cache is being invalidate because project e49d4eb3beaf406087a42c7228bf4ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:51.676118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.676975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.678969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1290/2579] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:51 2022] DELETE /identity/v3/projects/e49d4eb3beaf406087a42c7228bf4ae9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:51.683095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc43d24-20d7-4b4a-8d1c-026862cab6cf service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:51.699754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc43d24-20d7-4b4a-8d1c-026862cab6cf service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:51.764809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:51.820964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:51.822712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:51.823008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:51.823307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] PATH_INFO: `/v3/users/80fa064656b24ef6b65848d8607ba18f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:51.825232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80fa064656b24ef6b65848d8607ba18f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:51.827425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:51.895117 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80fa064656b24ef6b65848d8607ba18f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.895863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80fa064656b24ef6b65848d8607ba18f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.912341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80fa064656b24ef6b65848d8607ba18f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.925862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80fa064656b24ef6b65848d8607ba18f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.939755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80fa064656b24ef6b65848d8607ba18f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:51.947112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1290/2580] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:51 2022] DELETE /identity/v3/users/80fa064656b24ef6b65848d8607ba18f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:52.026145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:52.028812 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:52.049182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2913-1a3f-4581-b14b-686849072c72 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:52.110896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:52.111620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.112669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.112869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] PATH_INFO: `/v3/users/0d7a82606b784b43b2dc634b1418348a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.114206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7a82606b784b43b2dc634b1418348a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:52.116236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:52.155114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:52.171246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7a82606b784b43b2dc634b1418348a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.171912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7a82606b784b43b2dc634b1418348a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.184865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7a82606b784b43b2dc634b1418348a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.193305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7a82606b784b43b2dc634b1418348a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.193971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7a82606b784b43b2dc634b1418348a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.208076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1291/2581] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:52 2022] DELETE /identity/v3/users/0d7a82606b784b43b2dc634b1418348a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:52.247367 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:52.249356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:52.265052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8549fd-0aca-405b-acdb-ea5510ac6d5a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:52.330656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:52.331354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.331635 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.331910 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] PATH_INFO: `/v3/projects/848725961dda4fcdb30026e4ae60079f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.333139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] RBAC: Authorizing `identity:delete_project(project_id=848725961dda4fcdb30026e4ae60079f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:52.335125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:52.393926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848725961dda4fcdb30026e4ae60079f', 'request_id': 'req-146f30ee-1c90-429d-820f-c7465340368b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.396505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:52.407424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848725961dda4fcdb30026e4ae60079f', 'request_id': 'req-146f30ee-1c90-429d-820f-c7465340368b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.408588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:52.410461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:52.420968 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848725961dda4fcdb30026e4ae60079f', 'request_id': 'req-146f30ee-1c90-429d-820f-c7465340368b'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.428947 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb04a3f-23dd-4e93-9603-06117a272693 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:52.434243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] The token cache is being invalidate because project 848725961dda4fcdb30026e4ae60079f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:52.434515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.435219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-146f30ee-1c90-429d-820f-c7465340368b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.437971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1291/2582] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:52 2022] DELETE /identity/v3/projects/848725961dda4fcdb30026e4ae60079f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:52.448968 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959daf-d2f2-4ce0-bf9a-20df48bb83eb None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.449441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959daf-d2f2-4ce0-bf9a-20df48bb83eb None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.449693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959daf-d2f2-4ce0-bf9a-20df48bb83eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.473403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9b959daf-d2f2-4ce0-bf9a-20df48bb83eb None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:52.474633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9b959daf-d2f2-4ce0-bf9a-20df48bb83eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:52.498073 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:52.498631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.498907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.499207 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] PATH_INFO: `/v3/projects/4c790823211e466e8a5f685fd4d334d9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.500374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c790823211e466e8a5f685fd4d334d9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:52.502865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:52.549915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1292/2583] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:52.559159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cfdcf-9ea1-4074-8594-9c70e96647cf None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.559490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cfdcf-9ea1-4074-8594-9c70e96647cf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.559741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cfdcf-9ea1-4074-8594-9c70e96647cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.565579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c790823211e466e8a5f685fd4d334d9', 'request_id': 'req-f965d916-c8a7-4393-bed1-b15aba4eb407'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.572534 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c790823211e466e8a5f685fd4d334d9', 'request_id': 'req-f965d916-c8a7-4393-bed1-b15aba4eb407'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.581088 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a49cfdcf-9ea1-4074-8594-9c70e96647cf None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:52.583059 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c790823211e466e8a5f685fd4d334d9', 'request_id': 'req-f965d916-c8a7-4393-bed1-b15aba4eb407'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.583238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a49cfdcf-9ea1-4074-8594-9c70e96647cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:52.599828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] The token cache is being invalidate because project 4c790823211e466e8a5f685fd4d334d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:52.600099 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.600836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.602423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1292/2584] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:52 2022] DELETE /identity/v3/projects/4c790823211e466e8a5f685fd4d334d9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:52.606898 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:52.608848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:52.652497 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1293/2585] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:46:52.656862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cfdcf-9ea1-4074-8594-9c70e96647cf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:52.659174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:52.669681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cfdcf-9ea1-4074-8594-9c70e96647cf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:52.675228 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee32bc9-e5bc-4ce4-93de-2bed63e483a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:52.675850 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32bc9-e5bc-4ce4-93de-2bed63e483a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.676136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32bc9-e5bc-4ce4-93de-2bed63e483a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.676409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee32bc9-e5bc-4ce4-93de-2bed63e483a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.677105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee32bc9-e5bc-4ce4-93de-2bed63e483a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:46:52.677407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee32bc9-e5bc-4ce4-93de-2bed63e483a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:52.679032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee32bc9-e5bc-4ce4-93de-2bed63e483a5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:52.685982 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d916-c8a7-4393-bed1-b15aba4eb407 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:52.691531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:52.692253 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1294/2586] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:46:52.692419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.692761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.693054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] PATH_INFO: `/v3/users/e2cd2758dd5e4e6a88363e5a22550289` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.694388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cd2758dd5e4e6a88363e5a22550289)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:52.696443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee32bc9-e5bc-4ce4-93de-2bed63e483a5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:52.696646 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:52.708351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee32bc9-e5bc-4ce4-93de-2bed63e483a5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:52.713975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d6370-906d-4ab5-9f5b-d1575de7d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:52.714621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d6370-906d-4ab5-9f5b-d1575de7d4bd admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.714909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d6370-906d-4ab5-9f5b-d1575de7d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.715335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d6370-906d-4ab5-9f5b-d1575de7d4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.715996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d6370-906d-4ab5-9f5b-d1575de7d4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:52.718045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d6370-906d-4ab5-9f5b-d1575de7d4bd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:52.750644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1295/2587] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:52 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:46:52.755384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d6370-906d-4ab5-9f5b-d1575de7d4bd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:52.763651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cd2758dd5e4e6a88363e5a22550289'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.764383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cd2758dd5e4e6a88363e5a22550289'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.782351 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cd2758dd5e4e6a88363e5a22550289'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.793290 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cd2758dd5e4e6a88363e5a22550289'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.793946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cd2758dd5e4e6a88363e5a22550289'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:52.805751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:52.807665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1293/2588] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:52 2022] DELETE /identity/v3/users/e2cd2758dd5e4e6a88363e5a22550289 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:46:52.823713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d6370-906d-4ab5-9f5b-d1575de7d4bd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:52.907528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b55907-bd2d-4446-86c4-d77b90db8e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:52.908598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b55907-bd2d-4446-86c4-d77b90db8e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.908598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b55907-bd2d-4446-86c4-d77b90db8e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.909209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b55907-bd2d-4446-86c4-d77b90db8e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.909601 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b55907-bd2d-4446-86c4-d77b90db8e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:52.911621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b55907-bd2d-4446-86c4-d77b90db8e12 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:52.938108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1296/2589] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:52 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:46:52.940558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:52.942078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:52.958399 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e492dd-e30b-4867-a376-c9c86e24b40f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:52.967748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885f0ad-18ab-4233-b18f-d958a72b5cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:52.968956 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885f0ad-18ab-4233-b18f-d958a72b5cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:52.969437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885f0ad-18ab-4233-b18f-d958a72b5cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:52.969912 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885f0ad-18ab-4233-b18f-d958a72b5cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:52.971305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885f0ad-18ab-4233-b18f-d958a72b5cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:52.972939 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885f0ad-18ab-4233-b18f-d958a72b5cf5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:52.983958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1294/2590] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:52.988371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b55907-bd2d-4446-86c4-d77b90db8e12 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:53.000438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b55907-bd2d-4446-86c4-d77b90db8e12 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:53.003771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885f0ad-18ab-4233-b18f-d958a72b5cf5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:53.005780 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1885f0ad-18ab-4233-b18f-d958a72b5cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:53.006459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c9fa6-6369-4052-9acd-d5f26c80cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:53.007123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9fa6-6369-4052-9acd-d5f26c80cbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:53.007405 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9fa6-6369-4052-9acd-d5f26c80cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:53.007672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9fa6-6369-4052-9acd-d5f26c80cbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:53.008369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c9fa6-6369-4052-9acd-d5f26c80cbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:53.010038 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c9fa6-6369-4052-9acd-d5f26c80cbc8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:53.021741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885f0ad-18ab-4233-b18f-d958a72b5cf5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:53.027602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1297/2591] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:53.029203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c9fa6-6369-4052-9acd-d5f26c80cbc8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:53.031192 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:53.031917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:53.032258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:53.032591 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] PATH_INFO: `/v3/projects/3c1dcc9730264b099006d324c30f0d2c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:53.034814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1dcc9730264b099006d324c30f0d2c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:53.036880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:53.042519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c9fa6-6369-4052-9acd-d5f26c80cbc8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:53.049152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce96090-bdb1-48a4-8df2-d533f2fee57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:53.049936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96090-bdb1-48a4-8df2-d533f2fee57c admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:53.050216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96090-bdb1-48a4-8df2-d533f2fee57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:53.050744 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96090-bdb1-48a4-8df2-d533f2fee57c admin admin] PATH_INFO: `/v3/projects/6aa16849193046149feaa65159f2f28c/users/16c5ca66f15e47f887890e45735ad5f3/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:53.069380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce96090-bdb1-48a4-8df2-d533f2fee57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa16849193046149feaa65159f2f28c, user_id=16c5ca66f15e47f887890e45735ad5f3, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:53.072974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce96090-bdb1-48a4-8df2-d533f2fee57c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:53.087394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1298/2592] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:53 2022] PUT /identity/v3/projects/6aa16849193046149feaa65159f2f28c/users/16c5ca66f15e47f887890e45735ad5f3/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:46:53.098155 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9177e15-5a11-4a6a-a61b-032cab5e9d4f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:53.098441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9177e15-5a11-4a6a-a61b-032cab5e9d4f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:53.098717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9177e15-5a11-4a6a-a61b-032cab5e9d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:53.100216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1dcc9730264b099006d324c30f0d2c', 'request_id': 'req-77a4a11d-40ee-46c3-9af5-953a7a3d632f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.105894 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1dcc9730264b099006d324c30f0d2c', 'request_id': 'req-77a4a11d-40ee-46c3-9af5-953a7a3d632f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.114626 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1dcc9730264b099006d324c30f0d2c', 'request_id': 'req-77a4a11d-40ee-46c3-9af5-953a7a3d632f'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.126471 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] The token cache is being invalidate because project 3c1dcc9730264b099006d324c30f0d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:53.126767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.127189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b9177e15-5a11-4a6a-a61b-032cab5e9d4f None None] MFA Rules not processed for user `16c5ca66f15e47f887890e45735ad5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:53.127748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.128424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b9177e15-5a11-4a6a-a61b-032cab5e9d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:53.129253 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1295/2593] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:53 2022] DELETE /identity/v3/projects/3c1dcc9730264b099006d324c30f0d2c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:53.206275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1299/2594] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:46:53.218266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:53.219901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:53.259184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:53.292721 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4a11d-40ee-46c3-9af5-953a7a3d632f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:53.350706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f6da6-6938-4301-8073-91fcd8789f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:53.351396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6da6-6938-4301-8073-91fcd8789f89 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:53.351678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6da6-6938-4301-8073-91fcd8789f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:53.351966 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f6da6-6938-4301-8073-91fcd8789f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:53.362245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6da6-6938-4301-8073-91fcd8789f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:53.364101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f6da6-6938-4301-8073-91fcd8789f89 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:53.374733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1296/2595] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:53.394664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9177e15-5a11-4a6a-a61b-032cab5e9d4f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:53.396306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b9177e15-5a11-4a6a-a61b-032cab5e9d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:53.438638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:53.463039 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9177e15-5a11-4a6a-a61b-032cab5e9d4f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:53.467525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:53.468160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:53.468432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:53.468699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] PATH_INFO: `/v3/users/16c5ca66f15e47f887890e45735ad5f3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:53.469856 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c5ca66f15e47f887890e45735ad5f3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:53.472360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:53.519438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c5ca66f15e47f887890e45735ad5f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.520111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c5ca66f15e47f887890e45735ad5f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.534010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c5ca66f15e47f887890e45735ad5f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.541130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c5ca66f15e47f887890e45735ad5f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.549121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c5ca66f15e47f887890e45735ad5f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:53.555022 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1300/2596] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:53 2022] DELETE /identity/v3/users/16c5ca66f15e47f887890e45735ad5f3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:46:53.559405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a676f-9440-4b20-aaec-76ee7b1e2bdf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:53.559686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a676f-9440-4b20-aaec-76ee7b1e2bdf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:53.559955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a676f-9440-4b20-aaec-76ee7b1e2bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:53.580197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-dd8a676f-9440-4b20-aaec-76ee7b1e2bdf None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:53.581382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dd8a676f-9440-4b20-aaec-76ee7b1e2bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:53.639572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1297/2597] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:53.653867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:53.655468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:53.718147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f3b16-e0e6-4a2a-a2a2-e0ba65708534 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:53.722396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760389-b750-464e-8c13-53f0cd6b0b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:53.723030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760389-b750-464e-8c13-53f0cd6b0b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:53.723314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760389-b750-464e-8c13-53f0cd6b0b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:53.723583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760389-b750-464e-8c13-53f0cd6b0b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:53.732620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80760389-b750-464e-8c13-53f0cd6b0b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:53.734076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80760389-b750-464e-8c13-53f0cd6b0b7b service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:53.744900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1301/2598] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:54.015462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a676f-9440-4b20-aaec-76ee7b1e2bdf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:54.016986 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-dd8a676f-9440-4b20-aaec-76ee7b1e2bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:54.030870 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a676f-9440-4b20-aaec-76ee7b1e2bdf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:54.036655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:54.037310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.037587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.037859 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] PATH_INFO: `/v3/projects/6aa16849193046149feaa65159f2f28c` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.039111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa16849193046149feaa65159f2f28c)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:54.041026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:54.089028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa16849193046149feaa65159f2f28c', 'request_id': 'req-d7c1ebec-f680-45c2-b1b7-55de716d4cde'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.094258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa16849193046149feaa65159f2f28c', 'request_id': 'req-d7c1ebec-f680-45c2-b1b7-55de716d4cde'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.101995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa16849193046149feaa65159f2f28c', 'request_id': 'req-d7c1ebec-f680-45c2-b1b7-55de716d4cde'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.113043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] The token cache is being invalidate because project 6aa16849193046149feaa65159f2f28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:54.113328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.113949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c1ebec-f680-45c2-b1b7-55de716d4cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.115472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1298/2599] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:54 2022] DELETE /identity/v3/projects/6aa16849193046149feaa65159f2f28c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:54.120391 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75ee6-3a05-463a-9b95-91419adfdd12 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.120851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75ee6-3a05-463a-9b95-91419adfdd12 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.120970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75ee6-3a05-463a-9b95-91419adfdd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.139922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6be75ee6-3a05-463a-9b95-91419adfdd12 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:54.141149 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6be75ee6-3a05-463a-9b95-91419adfdd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:54.192862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:54.202886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1302/2600] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:46:54.211082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830bca-fe82-49f7-af4c-fb2facbf47a4 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.211370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830bca-fe82-49f7-af4c-fb2facbf47a4 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.211648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830bca-fe82-49f7-af4c-fb2facbf47a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.231703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2b830bca-fe82-49f7-af4c-fb2facbf47a4 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:54.232897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2b830bca-fe82-49f7-af4c-fb2facbf47a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:54.240964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1299/2601] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:54.245160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be75ee6-3a05-463a-9b95-91419adfdd12 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:54.254796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be75ee6-3a05-463a-9b95-91419adfdd12 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:54.259371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249041-8097-46bd-85b3-b02253afa035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:54.259971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249041-8097-46bd-85b3-b02253afa035 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.260247 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249041-8097-46bd-85b3-b02253afa035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.260515 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249041-8097-46bd-85b3-b02253afa035 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.261195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249041-8097-46bd-85b3-b02253afa035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:46:54.261520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249041-8097-46bd-85b3-b02253afa035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:54.263121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249041-8097-46bd-85b3-b02253afa035 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:54.275280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1303/2602] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:46:54.279388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830bca-fe82-49f7-af4c-fb2facbf47a4 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:54.289453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830bca-fe82-49f7-af4c-fb2facbf47a4 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:54.294159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510af7-08e1-431b-adda-ceebe15e955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:54.294770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510af7-08e1-431b-adda-ceebe15e955f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.295110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510af7-08e1-431b-adda-ceebe15e955f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.295360 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510af7-08e1-431b-adda-ceebe15e955f admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.296027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510af7-08e1-431b-adda-ceebe15e955f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:54.297921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510af7-08e1-431b-adda-ceebe15e955f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:54.302544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:54.333182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1300/2603] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:54 2022] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:54.337125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249041-8097-46bd-85b3-b02253afa035 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:54.348156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249041-8097-46bd-85b3-b02253afa035 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:54.406710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5689-ace6-4c56-81a7-791ececfa6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:54.407350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5689-ace6-4c56-81a7-791ececfa6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.407680 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5689-ace6-4c56-81a7-791ececfa6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.408463 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5689-ace6-4c56-81a7-791ececfa6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.409409 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5689-ace6-4c56-81a7-791ececfa6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:54.411337 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5689-ace6-4c56-81a7-791ececfa6a0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:54.434091 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1304/2604] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:54 2022] POST /identity/v3/users => generated 281 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:54.438196 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510af7-08e1-431b-adda-ceebe15e955f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:54.448964 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510af7-08e1-431b-adda-ceebe15e955f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:54.453487 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656adc7e-7a90-4502-867c-1d74d2102949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:54.454096 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656adc7e-7a90-4502-867c-1d74d2102949 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.454373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656adc7e-7a90-4502-867c-1d74d2102949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.455373 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656adc7e-7a90-4502-867c-1d74d2102949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.456181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656adc7e-7a90-4502-867c-1d74d2102949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:54.457775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656adc7e-7a90-4502-867c-1d74d2102949 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:54.468186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1301/2605] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:54.472334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5689-ace6-4c56-81a7-791ececfa6a0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:54.482907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5689-ace6-4c56-81a7-791ececfa6a0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:54.487837 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d9ee0-7ec4-43d2-80e0-9e0e94b9412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:54.488458 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d9ee0-7ec4-43d2-80e0-9e0e94b9412d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.488738 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d9ee0-7ec4-43d2-80e0-9e0e94b9412d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.489010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d9ee0-7ec4-43d2-80e0-9e0e94b9412d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.489742 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d9ee0-7ec4-43d2-80e0-9e0e94b9412d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:54.491381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d9ee0-7ec4-43d2-80e0-9e0e94b9412d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:54.503066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1305/2606] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:54.507377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656adc7e-7a90-4502-867c-1d74d2102949 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:54.518659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656adc7e-7a90-4502-867c-1d74d2102949 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:54.523376 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3178ad-3b59-4bbf-b85f-64bb818ed46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:54.524042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3178ad-3b59-4bbf-b85f-64bb818ed46e admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.524340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3178ad-3b59-4bbf-b85f-64bb818ed46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.524618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3178ad-3b59-4bbf-b85f-64bb818ed46e admin admin] PATH_INFO: `/v3/projects/3366e864f4cf4306a6d629b829d3b0fb/users/028e8356aac747888d7b72923282f46f/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.542314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3178ad-3b59-4bbf-b85f-64bb818ed46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3366e864f4cf4306a6d629b829d3b0fb, user_id=028e8356aac747888d7b72923282f46f, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:54.545055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3178ad-3b59-4bbf-b85f-64bb818ed46e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:54.558466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1302/2607] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:54 2022] PUT /identity/v3/projects/3366e864f4cf4306a6d629b829d3b0fb/users/028e8356aac747888d7b72923282f46f/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:54.570201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f6e6-d5b0-4ff0-ac78-d74a6cbb9548 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.570547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f6e6-d5b0-4ff0-ac78-d74a6cbb9548 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.570848 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f6e6-d5b0-4ff0-ac78-d74a6cbb9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.601349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7071f6e6-d5b0-4ff0-ac78-d74a6cbb9548 None None] MFA Rules not processed for user `028e8356aac747888d7b72923282f46f`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:54.602512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7071f6e6-d5b0-4ff0-ac78-d74a6cbb9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:54.670416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1306/2608] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:54.706633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3178ad-3b59-4bbf-b85f-64bb818ed46e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:54.709062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8e3178ad-3b59-4bbf-b85f-64bb818ed46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:54.775696 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3178ad-3b59-4bbf-b85f-64bb818ed46e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:54.779336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3c75c-85db-4ba4-b9b0-ba7460747eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:54.779948 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c75c-85db-4ba4-b9b0-ba7460747eae service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.780229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c75c-85db-4ba4-b9b0-ba7460747eae service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.780502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c75c-85db-4ba4-b9b0-ba7460747eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.789362 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3c75c-85db-4ba4-b9b0-ba7460747eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:54.790793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3c75c-85db-4ba4-b9b0-ba7460747eae service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:54.799683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1303/2609] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:54.815239 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f6e6-d5b0-4ff0-ac78-d74a6cbb9548 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:54.877891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:54.883993 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f6e6-d5b0-4ff0-ac78-d74a6cbb9548 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:54.888825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:54.889460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.889734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.890002 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] PATH_INFO: `/v3/users/028e8356aac747888d7b72923282f46f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:54.891204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] RBAC: Authorizing `identity:delete_user(user_id=028e8356aac747888d7b72923282f46f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:54.893254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:54.943757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028e8356aac747888d7b72923282f46f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.944416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028e8356aac747888d7b72923282f46f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.958370 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028e8356aac747888d7b72923282f46f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.965717 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028e8356aac747888d7b72923282f46f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.974973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028e8356aac747888d7b72923282f46f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:54.980983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1307/2610] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:46:54 2022] DELETE /identity/v3/users/028e8356aac747888d7b72923282f46f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:54.985509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c42ae3-15e1-4ae0-8d09-b8f55c63a896 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:54.985826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c42ae3-15e1-4ae0-8d09-b8f55c63a896 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:54.986101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c42ae3-15e1-4ae0-8d09-b8f55c63a896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.005005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-f1c42ae3-15e1-4ae0-8d09-b8f55c63a896 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:55.006198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f1c42ae3-15e1-4ae0-8d09-b8f55c63a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:55.066658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1304/2611] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:55.076781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:55.078215 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:55.137776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995dd27-b4f0-4430-8e8a-786103b8212c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:55.141562 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae443da-7f43-472d-be0b-6215ef0fd9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:55.142666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae443da-7f43-472d-be0b-6215ef0fd9bf service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.142945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae443da-7f43-472d-be0b-6215ef0fd9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.143249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae443da-7f43-472d-be0b-6215ef0fd9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.152631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae443da-7f43-472d-be0b-6215ef0fd9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:55.154059 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae443da-7f43-472d-be0b-6215ef0fd9bf service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:55.165551 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1308/2612] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:55.444197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c42ae3-15e1-4ae0-8d09-b8f55c63a896 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:55.446339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f1c42ae3-15e1-4ae0-8d09-b8f55c63a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:55.459513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c42ae3-15e1-4ae0-8d09-b8f55c63a896 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:55.464135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:55.464779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.465055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.465356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] PATH_INFO: `/v3/projects/3366e864f4cf4306a6d629b829d3b0fb` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.466549 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3366e864f4cf4306a6d629b829d3b0fb)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:55.468531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:55.514491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:55.515813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3366e864f4cf4306a6d629b829d3b0fb', 'request_id': 'req-5654c027-8a93-4ad6-ac7d-2a3f2521b381'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:55.523677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3366e864f4cf4306a6d629b829d3b0fb', 'request_id': 'req-5654c027-8a93-4ad6-ac7d-2a3f2521b381'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:55.532086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3366e864f4cf4306a6d629b829d3b0fb', 'request_id': 'req-5654c027-8a93-4ad6-ac7d-2a3f2521b381'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:55.543817 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] The token cache is being invalidate because project 3366e864f4cf4306a6d629b829d3b0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:46:55.544105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:55.544754 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5654c027-8a93-4ad6-ac7d-2a3f2521b381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:46:55.546371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1305/2613] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:46:55 2022] DELETE /identity/v3/projects/3366e864f4cf4306a6d629b829d3b0fb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:55.551445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f984ed-8780-43ba-934c-e73b1b7ae391 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.551732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f984ed-8780-43ba-934c-e73b1b7ae391 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.552007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f984ed-8780-43ba-934c-e73b1b7ae391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.572979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-65f984ed-8780-43ba-934c-e73b1b7ae391 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:55.574224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-65f984ed-8780-43ba-934c-e73b1b7ae391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:55.635084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1309/2614] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:55.642685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5608e-c1e9-4e6f-b58b-b7d4420bb159 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.642972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5608e-c1e9-4e6f-b58b-b7d4420bb159 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.643277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5608e-c1e9-4e6f-b58b-b7d4420bb159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.662847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b0e5608e-c1e9-4e6f-b58b-b7d4420bb159 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:55.664071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b0e5608e-c1e9-4e6f-b58b-b7d4420bb159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:55.671984 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1306/2615] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:55.676763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f984ed-8780-43ba-934c-e73b1b7ae391 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:55.686450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f984ed-8780-43ba-934c-e73b1b7ae391 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:55.691576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de7c9d-c7d8-488e-8187-d315214bf84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:55.692182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de7c9d-c7d8-488e-8187-d315214bf84f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.692460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de7c9d-c7d8-488e-8187-d315214bf84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.692731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de7c9d-c7d8-488e-8187-d315214bf84f admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.693417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de7c9d-c7d8-488e-8187-d315214bf84f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:46:55.693718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de7c9d-c7d8-488e-8187-d315214bf84f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:55.695341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de7c9d-c7d8-488e-8187-d315214bf84f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:55.707361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1310/2616] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:46:55.711501 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5608e-c1e9-4e6f-b58b-b7d4420bb159 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:55.720844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5608e-c1e9-4e6f-b58b-b7d4420bb159 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:55.725511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5a956-f714-4649-9fd3-824eb20330ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:55.726105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a956-f714-4649-9fd3-824eb20330ca admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.726384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a956-f714-4649-9fd3-824eb20330ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.726657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a956-f714-4649-9fd3-824eb20330ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.727360 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5a956-f714-4649-9fd3-824eb20330ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:55.729283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5a956-f714-4649-9fd3-824eb20330ca admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:55.758029 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1307/2617] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:55 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:55.762280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de7c9d-c7d8-488e-8187-d315214bf84f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:55.768872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:55.773424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de7c9d-c7d8-488e-8187-d315214bf84f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:55.831519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559799e-e096-46a6-81dc-1ba6a3446ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:55.832137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559799e-e096-46a6-81dc-1ba6a3446ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.832416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559799e-e096-46a6-81dc-1ba6a3446ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.832687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559799e-e096-46a6-81dc-1ba6a3446ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.833351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559799e-e096-46a6-81dc-1ba6a3446ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:55.835270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559799e-e096-46a6-81dc-1ba6a3446ca1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:55.856219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1311/2618] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:55 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:46:55.860323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5a956-f714-4649-9fd3-824eb20330ca admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:55.871497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5a956-f714-4649-9fd3-824eb20330ca admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:55.876176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aef1c-a77b-4d58-beab-96a5414a7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:55.877379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aef1c-a77b-4d58-beab-96a5414a7788 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.877663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aef1c-a77b-4d58-beab-96a5414a7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.878181 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aef1c-a77b-4d58-beab-96a5414a7788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.878903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aef1c-a77b-4d58-beab-96a5414a7788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:55.880579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aef1c-a77b-4d58-beab-96a5414a7788 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:55.892299 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1308/2619] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:55.896246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559799e-e096-46a6-81dc-1ba6a3446ca1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:55.907201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559799e-e096-46a6-81dc-1ba6a3446ca1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:55.912830 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f47b9-e6b1-434f-817c-022b288dbd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:55.913101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f47b9-e6b1-434f-817c-022b288dbd15 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.913357 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f47b9-e6b1-434f-817c-022b288dbd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.913626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f47b9-e6b1-434f-817c-022b288dbd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.914395 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f47b9-e6b1-434f-817c-022b288dbd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:55.916040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f47b9-e6b1-434f-817c-022b288dbd15 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:55.928725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1312/2620] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:55.933247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aef1c-a77b-4d58-beab-96a5414a7788 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:55.944756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aef1c-a77b-4d58-beab-96a5414a7788 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:55.949842 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c142-ce62-44ca-872f-d079d37c0a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:55.950610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c142-ce62-44ca-872f-d079d37c0a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.950889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c142-ce62-44ca-872f-d079d37c0a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:55.951194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c142-ce62-44ca-872f-d079d37c0a60 admin admin] PATH_INFO: `/v3/projects/7dc31b23f3334d098af71bf07651f4a4/users/0f3e4d7b6b4648a38334fc474dcafab2/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:55.969093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801c142-ce62-44ca-872f-d079d37c0a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc31b23f3334d098af71bf07651f4a4, user_id=0f3e4d7b6b4648a38334fc474dcafab2, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:55.972390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801c142-ce62-44ca-872f-d079d37c0a60 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:55.989153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1309/2621] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:55 2022] PUT /identity/v3/projects/7dc31b23f3334d098af71bf07651f4a4/users/0f3e4d7b6b4648a38334fc474dcafab2/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:55.999569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934223f-9930-4604-adab-ab17e4c7bcaf None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:55.999853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934223f-9930-4604-adab-ab17e4c7bcaf None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.000123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934223f-9930-4604-adab-ab17e4c7bcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.028991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d934223f-9930-4604-adab-ab17e4c7bcaf None None] MFA Rules not processed for user `0f3e4d7b6b4648a38334fc474dcafab2`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:56.030207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d934223f-9930-4604-adab-ab17e4c7bcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:56.094871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1313/2622] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:56.099884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c142-ce62-44ca-872f-d079d37c0a60 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.161215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c142-ce62-44ca-872f-d079d37c0a60 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.165848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b98814-e985-4902-ae94-6d5c72f9c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.166461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98814-e985-4902-ae94-6d5c72f9c6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.166742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98814-e985-4902-ae94-6d5c72f9c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.167037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98814-e985-4902-ae94-6d5c72f9c6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.167707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b98814-e985-4902-ae94-6d5c72f9c6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.169592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b98814-e985-4902-ae94-6d5c72f9c6b7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.196324 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1310/2623] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:56 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:56.200542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934223f-9930-4604-adab-ab17e4c7bcaf None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.211294 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934223f-9930-4604-adab-ab17e4c7bcaf None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.269922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623d282-2866-4d7c-949d-eb6a7cd87b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.270536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623d282-2866-4d7c-949d-eb6a7cd87b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.270815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623d282-2866-4d7c-949d-eb6a7cd87b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.271119 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623d282-2866-4d7c-949d-eb6a7cd87b32 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.271777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623d282-2866-4d7c-949d-eb6a7cd87b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.273678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623d282-2866-4d7c-949d-eb6a7cd87b32 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.295636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1314/2624] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:56 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:56.300161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b98814-e985-4902-ae94-6d5c72f9c6b7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.310656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b98814-e985-4902-ae94-6d5c72f9c6b7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.315422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afbbda-d7f3-48ff-a761-39cbda48ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.316038 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbbda-d7f3-48ff-a761-39cbda48ee99 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.316317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbbda-d7f3-48ff-a761-39cbda48ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.316615 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbbda-d7f3-48ff-a761-39cbda48ee99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.317307 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afbbda-d7f3-48ff-a761-39cbda48ee99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.318888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afbbda-d7f3-48ff-a761-39cbda48ee99 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.329407 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1311/2625] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:56.333793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623d282-2866-4d7c-949d-eb6a7cd87b32 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.339021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:56.346049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623d282-2866-4d7c-949d-eb6a7cd87b32 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.351378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68fd99-5603-42af-bcff-78ab799dabdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.351990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fd99-5603-42af-bcff-78ab799dabdb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.352271 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fd99-5603-42af-bcff-78ab799dabdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.352544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fd99-5603-42af-bcff-78ab799dabdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.353238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68fd99-5603-42af-bcff-78ab799dabdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.354835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68fd99-5603-42af-bcff-78ab799dabdb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.365210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1315/2626] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:56.369447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afbbda-d7f3-48ff-a761-39cbda48ee99 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.379527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afbbda-d7f3-48ff-a761-39cbda48ee99 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.384221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20043cf6-cf58-40e4-a1cf-6f8975be4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.384899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20043cf6-cf58-40e4-a1cf-6f8975be4df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.385179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20043cf6-cf58-40e4-a1cf-6f8975be4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.385453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20043cf6-cf58-40e4-a1cf-6f8975be4df4 admin admin] PATH_INFO: `/v3/projects/7091d552d3ab41918f7f305b1797210f/users/fc76d16fd1504fd4aad15ffbff8be685/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.402334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20043cf6-cf58-40e4-a1cf-6f8975be4df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7091d552d3ab41918f7f305b1797210f, user_id=fc76d16fd1504fd4aad15ffbff8be685, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.405067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20043cf6-cf58-40e4-a1cf-6f8975be4df4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.420884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1312/2627] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:56 2022] PUT /identity/v3/projects/7091d552d3ab41918f7f305b1797210f/users/fc76d16fd1504fd4aad15ffbff8be685/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:56.432493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57818bb9-5968-4650-8d67-cf5039ff8f9f None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.432773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57818bb9-5968-4650-8d67-cf5039ff8f9f None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.433045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57818bb9-5968-4650-8d67-cf5039ff8f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.463330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-57818bb9-5968-4650-8d67-cf5039ff8f9f None None] MFA Rules not processed for user `fc76d16fd1504fd4aad15ffbff8be685`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:56.464460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-57818bb9-5968-4650-8d67-cf5039ff8f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:56.530906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1316/2628] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:56.537270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20043cf6-cf58-40e4-a1cf-6f8975be4df4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.570663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:56.610068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20043cf6-cf58-40e4-a1cf-6f8975be4df4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.614570 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5973dd-e654-4b7f-9822-e0196863d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.615210 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5973dd-e654-4b7f-9822-e0196863d386 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.615486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5973dd-e654-4b7f-9822-e0196863d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.615756 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5973dd-e654-4b7f-9822-e0196863d386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.616414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5973dd-e654-4b7f-9822-e0196863d386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.618355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5973dd-e654-4b7f-9822-e0196863d386 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.644990 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1313/2629] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:46:56 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:56.649587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57818bb9-5968-4650-8d67-cf5039ff8f9f None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.661451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57818bb9-5968-4650-8d67-cf5039ff8f9f None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.719702 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea035-f714-4a18-aee8-ac15f71db027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.720312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea035-f714-4a18-aee8-ac15f71db027 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.720591 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea035-f714-4a18-aee8-ac15f71db027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.720853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea035-f714-4a18-aee8-ac15f71db027 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.721516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ea035-f714-4a18-aee8-ac15f71db027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.723461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ea035-f714-4a18-aee8-ac15f71db027 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.751762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1317/2630] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:46:56 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:46:56.755740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5973dd-e654-4b7f-9822-e0196863d386 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.766451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5973dd-e654-4b7f-9822-e0196863d386 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.772186 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa546-8820-4c74-b6df-8f0579e1c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.773043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa546-8820-4c74-b6df-8f0579e1c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.773318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa546-8820-4c74-b6df-8f0579e1c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.773592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa546-8820-4c74-b6df-8f0579e1c3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.774456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faa546-8820-4c74-b6df-8f0579e1c3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.776127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faa546-8820-4c74-b6df-8f0579e1c3d3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.787343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1314/2631] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:56.791596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea035-f714-4a18-aee8-ac15f71db027 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.801622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea035-f714-4a18-aee8-ac15f71db027 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.806386 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1994-6ac9-4ea3-a3ed-ae7d290d4bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.807105 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1994-6ac9-4ea3-a3ed-ae7d290d4bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.807415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1994-6ac9-4ea3-a3ed-ae7d290d4bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.807689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1994-6ac9-4ea3-a3ed-ae7d290d4bc3 admin admin] PATH_INFO: `/v3/projects/47410384c0b44ae39c1245fd8bb1730d/users/3ba4729ba908401190b11efdbf76e755/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.823071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b1994-6ac9-4ea3-a3ed-ae7d290d4bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47410384c0b44ae39c1245fd8bb1730d, user_id=3ba4729ba908401190b11efdbf76e755, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.825816 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b1994-6ac9-4ea3-a3ed-ae7d290d4bc3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.840061 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1318/2632] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:56 2022] PUT /identity/v3/projects/47410384c0b44ae39c1245fd8bb1730d/users/3ba4729ba908401190b11efdbf76e755/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:46:56.843971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa546-8820-4c74-b6df-8f0579e1c3d3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.853914 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa546-8820-4c74-b6df-8f0579e1c3d3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.909580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad12bc0-a0b1-473e-82c9-f3d71f3640ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.910205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12bc0-a0b1-473e-82c9-f3d71f3640ac admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.910463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12bc0-a0b1-473e-82c9-f3d71f3640ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.910731 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad12bc0-a0b1-473e-82c9-f3d71f3640ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.911444 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad12bc0-a0b1-473e-82c9-f3d71f3640ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.913012 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad12bc0-a0b1-473e-82c9-f3d71f3640ac admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.922425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1315/2633] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:46:56.926656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1994-6ac9-4ea3-a3ed-ae7d290d4bc3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:56.936975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1994-6ac9-4ea3-a3ed-ae7d290d4bc3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:56.942032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01725f0b-ed1a-4da3-9798-0c8e9c942e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:56.942748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01725f0b-ed1a-4da3-9798-0c8e9c942e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.943057 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01725f0b-ed1a-4da3-9798-0c8e9c942e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.943333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01725f0b-ed1a-4da3-9798-0c8e9c942e91 admin admin] PATH_INFO: `/v3/projects/47410384c0b44ae39c1245fd8bb1730d/users/3ba4729ba908401190b11efdbf76e755/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.945295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01725f0b-ed1a-4da3-9798-0c8e9c942e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47410384c0b44ae39c1245fd8bb1730d, user_id=3ba4729ba908401190b11efdbf76e755, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:56.947954 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01725f0b-ed1a-4da3-9798-0c8e9c942e91 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:56.958812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1319/2634] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:46:56 2022] PUT /identity/v3/projects/47410384c0b44ae39c1245fd8bb1730d/users/3ba4729ba908401190b11efdbf76e755/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:46:56.968649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927cc44-58c8-4459-a1bf-d6a709f75396 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:56.968940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927cc44-58c8-4459-a1bf-d6a709f75396 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:56.969225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927cc44-58c8-4459-a1bf-d6a709f75396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:56.998963 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a927cc44-58c8-4459-a1bf-d6a709f75396 None None] MFA Rules not processed for user `3ba4729ba908401190b11efdbf76e755`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:46:57.000147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a927cc44-58c8-4459-a1bf-d6a709f75396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:57.070572 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1316/2635] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:46:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:46:57.082487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01725f0b-ed1a-4da3-9798-0c8e9c942e91 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:57.084243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-01725f0b-ed1a-4da3-9798-0c8e9c942e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:57.130589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:57.159127 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01725f0b-ed1a-4da3-9798-0c8e9c942e91 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:57.163622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a2c92-5b51-42a7-ba7e-95586d8ce87a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:57.164443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a2c92-5b51-42a7-ba7e-95586d8ce87a service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:57.164776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a2c92-5b51-42a7-ba7e-95586d8ce87a service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:57.165048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a2c92-5b51-42a7-ba7e-95586d8ce87a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:57.226202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a2c92-5b51-42a7-ba7e-95586d8ce87a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:57.227831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a2c92-5b51-42a7-ba7e-95586d8ce87a service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:57.240428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1320/2636] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:58.783358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927cc44-58c8-4459-a1bf-d6a709f75396 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:58.785064 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a927cc44-58c8-4459-a1bf-d6a709f75396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:46:58.797195 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927cc44-58c8-4459-a1bf-d6a709f75396 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:58.800701 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b7a5-4d9f-4162-9198-00193769c4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:58.801306 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b7a5-4d9f-4162-9198-00193769c4cc service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:58.801580 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b7a5-4d9f-4162-9198-00193769c4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:58.801847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b7a5-4d9f-4162-9198-00193769c4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:58.814606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:46:58.861996 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460b7a5-4d9f-4162-9198-00193769c4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:58.863400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460b7a5-4d9f-4162-9198-00193769c4cc service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:58.877643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1317/2637] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:46:59.422026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a2c92-5b51-42a7-ba7e-95586d8ce87a service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:46:59.431411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a2c92-5b51-42a7-ba7e-95586d8ce87a service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:46:59.435094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301195dc-b1c8-4c31-b85f-2357430af949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:46:59.435703 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301195dc-b1c8-4c31-b85f-2357430af949 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:46:59.435983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301195dc-b1c8-4c31-b85f-2357430af949 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:46:59.436256 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301195dc-b1c8-4c31-b85f-2357430af949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:46:59.446124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301195dc-b1c8-4c31-b85f-2357430af949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:46:59.447695 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301195dc-b1c8-4c31-b85f-2357430af949 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:46:59.457298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1321/2638] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:46:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:03.545090 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b7a5-4d9f-4162-9198-00193769c4cc service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:03.614415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b7a5-4d9f-4162-9198-00193769c4cc service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:03.618921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:03.619595 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:03.619869 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:03.620141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] PATH_INFO: `/v3/users/0f3e4d7b6b4648a38334fc474dcafab2` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:03.621301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3e4d7b6b4648a38334fc474dcafab2)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:03.623239 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:03.677271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3e4d7b6b4648a38334fc474dcafab2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:03.678039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3e4d7b6b4648a38334fc474dcafab2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:03.695136 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3e4d7b6b4648a38334fc474dcafab2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:03.708389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3e4d7b6b4648a38334fc474dcafab2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:03.709275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3e4d7b6b4648a38334fc474dcafab2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:03.733268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1318/2639] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:03 2022] DELETE /identity/v3/users/0f3e4d7b6b4648a38334fc474dcafab2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:03.741006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ab235-dd55-42c2-bc4d-df486ece131c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:03.741513 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ab235-dd55-42c2-bc4d-df486ece131c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:03.741859 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ab235-dd55-42c2-bc4d-df486ece131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:03.762880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7a1ab235-dd55-42c2-bc4d-df486ece131c None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:03.764167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7a1ab235-dd55-42c2-bc4d-df486ece131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:03.833907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1322/2640] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:03.843556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:03.845170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:03.897689 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:03.917740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfd917-38c6-4b9d-ba13-1c39dfbfc52a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:03.921690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c113438-9a4f-4c73-8484-e91dd158d246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:03.922315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c113438-9a4f-4c73-8484-e91dd158d246 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:03.922597 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c113438-9a4f-4c73-8484-e91dd158d246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:03.922902 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c113438-9a4f-4c73-8484-e91dd158d246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:03.932733 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c113438-9a4f-4c73-8484-e91dd158d246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:03.934183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c113438-9a4f-4c73-8484-e91dd158d246 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:03.944523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1319/2641] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:47:04.307995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ab235-dd55-42c2-bc4d-df486ece131c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:04.309559 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7a1ab235-dd55-42c2-bc4d-df486ece131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:04.323806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ab235-dd55-42c2-bc4d-df486ece131c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:04.329938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:04.330845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:04.331152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:04.331419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] PATH_INFO: `/v3/projects/7dc31b23f3334d098af71bf07651f4a4` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:04.333221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc31b23f3334d098af71bf07651f4a4)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:04.334581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:04.392512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc31b23f3334d098af71bf07651f4a4', 'request_id': 'req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.398083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc31b23f3334d098af71bf07651f4a4', 'request_id': 'req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.405781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc31b23f3334d098af71bf07651f4a4', 'request_id': 'req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.413213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:04.418763 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] The token cache is being invalidate because project 7dc31b23f3334d098af71bf07651f4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:04.419259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.420318 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.422151 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1323/2642] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:04 2022] DELETE /identity/v3/projects/7dc31b23f3334d098af71bf07651f4a4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:04.426150 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c113438-9a4f-4c73-8484-e91dd158d246 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:04.436949 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c113438-9a4f-4c73-8484-e91dd158d246 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:04.503244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:04.503811 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:04.504102 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:04.504396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] PATH_INFO: `/v3/users/fc76d16fd1504fd4aad15ffbff8be685` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:04.505557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc76d16fd1504fd4aad15ffbff8be685)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:04.507519 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:04.556114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc76d16fd1504fd4aad15ffbff8be685'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.556752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc76d16fd1504fd4aad15ffbff8be685'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.569502 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc76d16fd1504fd4aad15ffbff8be685'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.576535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc76d16fd1504fd4aad15ffbff8be685'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.577156 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc76d16fd1504fd4aad15ffbff8be685'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:04.590168 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1320/2643] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:04 2022] DELETE /identity/v3/users/fc76d16fd1504fd4aad15ffbff8be685 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:04.873984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:04.875786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:04.889389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097f65c-a9cf-4bcd-96b0-d758c6ef04f9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:04.961803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:04.962547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:04.962827 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:04.963140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] PATH_INFO: `/v3/projects/7091d552d3ab41918f7f305b1797210f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:04.964324 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7091d552d3ab41918f7f305b1797210f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:04.966437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:05.013469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7091d552d3ab41918f7f305b1797210f', 'request_id': 'req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.018839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7091d552d3ab41918f7f305b1797210f', 'request_id': 'req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.026246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7091d552d3ab41918f7f305b1797210f', 'request_id': 'req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.037987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] The token cache is being invalidate because project 7091d552d3ab41918f7f305b1797210f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:05.038269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.038887 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.040755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1324/2644] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:04 2022] DELETE /identity/v3/projects/7091d552d3ab41918f7f305b1797210f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:05.044730 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:05.046116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:05.059150 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df3b4-c981-48c1-9a69-d008b8d56c4d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:05.109483 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:05.116571 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:05.117601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:05.117886 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:05.118174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] PATH_INFO: `/v3/users/3ba4729ba908401190b11efdbf76e755` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:05.119847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba4729ba908401190b11efdbf76e755)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:05.122255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:05.172772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba4729ba908401190b11efdbf76e755'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.174044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba4729ba908401190b11efdbf76e755'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.185932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba4729ba908401190b11efdbf76e755'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.193634 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba4729ba908401190b11efdbf76e755'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.194401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e27bfa45-7e9b-4e0c-9681-d0589833ba1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba4729ba908401190b11efdbf76e755'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.208205 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1321/2645] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:05 2022] DELETE /identity/v3/users/3ba4729ba908401190b11efdbf76e755 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:05.545493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:05.550570 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:05.566374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880f995-0c9a-4cd0-ace8-7cdcd1b3d754 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:05.656669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:05.659146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:05.659146 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:05.659400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] PATH_INFO: `/v3/projects/47410384c0b44ae39c1245fd8bb1730d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:05.664896 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47410384c0b44ae39c1245fd8bb1730d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:05.668636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:05.715606 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:05.738411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47410384c0b44ae39c1245fd8bb1730d', 'request_id': 'req-71dfbd06-0912-42c2-9388-86eb674da07f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.744204 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47410384c0b44ae39c1245fd8bb1730d', 'request_id': 'req-71dfbd06-0912-42c2-9388-86eb674da07f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.751459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47410384c0b44ae39c1245fd8bb1730d', 'request_id': 'req-71dfbd06-0912-42c2-9388-86eb674da07f'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.764544 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] The token cache is being invalidate because project 47410384c0b44ae39c1245fd8bb1730d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:05.764842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.765573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-71dfbd06-0912-42c2-9388-86eb674da07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:05.767368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1325/2646] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:05 2022] DELETE /identity/v3/projects/47410384c0b44ae39c1245fd8bb1730d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:05.773371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b091-6273-490d-8836-2dd3a3ea8ca5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:05.773856 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b091-6273-490d-8836-2dd3a3ea8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:05.774242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b091-6273-490d-8836-2dd3a3ea8ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:05.796222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-0023b091-6273-490d-8836-2dd3a3ea8ca5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:05.797424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0023b091-6273-490d-8836-2dd3a3ea8ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:05.859677 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1322/2647] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:05.869070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47481a-ca44-49e4-a4aa-c6011f17d5a2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:05.869380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47481a-ca44-49e4-a4aa-c6011f17d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:05.869651 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47481a-ca44-49e4-a4aa-c6011f17d5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:05.890626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9e47481a-ca44-49e4-a4aa-c6011f17d5a2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:05.891870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9e47481a-ca44-49e4-a4aa-c6011f17d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:05.900332 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1326/2648] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:05.904878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b091-6273-490d-8836-2dd3a3ea8ca5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:05.915785 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b091-6273-490d-8836-2dd3a3ea8ca5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:05.920448 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b89f6-5572-4629-ac26-a43a9b69d872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:05.921055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b89f6-5572-4629-ac26-a43a9b69d872 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:05.921334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b89f6-5572-4629-ac26-a43a9b69d872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:05.921603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b89f6-5572-4629-ac26-a43a9b69d872 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:05.922292 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b89f6-5572-4629-ac26-a43a9b69d872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:47:05.922617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b89f6-5572-4629-ac26-a43a9b69d872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:05.924771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b89f6-5572-4629-ac26-a43a9b69d872 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:05.936423 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1323/2649] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:47:06.005788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47481a-ca44-49e4-a4aa-c6011f17d5a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:06.016373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47481a-ca44-49e4-a4aa-c6011f17d5a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:06.021621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aafa6-c444-454a-9058-e4eeffd1ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:06.024211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aafa6-c444-454a-9058-e4eeffd1ba44 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:06.024211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aafa6-c444-454a-9058-e4eeffd1ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:06.024211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aafa6-c444-454a-9058-e4eeffd1ba44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:06.024211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aafa6-c444-454a-9058-e4eeffd1ba44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:06.026959 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aafa6-c444-454a-9058-e4eeffd1ba44 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:06.068493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1327/2650] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:06 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:06.072926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b89f6-5572-4629-ac26-a43a9b69d872 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:06.083690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b89f6-5572-4629-ac26-a43a9b69d872 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:06.139903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da4c77-d953-4da5-9c05-32f2f6dfa6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:06.140414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da4c77-d953-4da5-9c05-32f2f6dfa6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:06.140690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da4c77-d953-4da5-9c05-32f2f6dfa6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:06.140959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da4c77-d953-4da5-9c05-32f2f6dfa6dd admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:06.142124 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da4c77-d953-4da5-9c05-32f2f6dfa6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:06.144077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da4c77-d953-4da5-9c05-32f2f6dfa6dd admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:06.153777 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:06.167876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1324/2651] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:06 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:06.172246 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aafa6-c444-454a-9058-e4eeffd1ba44 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:06.182801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aafa6-c444-454a-9058-e4eeffd1ba44 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:06.187494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b504b-ad49-467a-b83b-295865f3d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:06.188116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b504b-ad49-467a-b83b-295865f3d0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:06.188399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b504b-ad49-467a-b83b-295865f3d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:06.188675 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b504b-ad49-467a-b83b-295865f3d0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:06.189402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b504b-ad49-467a-b83b-295865f3d0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:06.191025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b504b-ad49-467a-b83b-295865f3d0f0 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:06.202086 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1328/2652] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:06.207091 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da4c77-d953-4da5-9c05-32f2f6dfa6dd admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:06.217541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da4c77-d953-4da5-9c05-32f2f6dfa6dd admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:06.223542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffd715-7397-47b5-ae9e-fc25fe9dea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:06.224184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffd715-7397-47b5-ae9e-fc25fe9dea60 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:06.224470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffd715-7397-47b5-ae9e-fc25fe9dea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:06.224744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffd715-7397-47b5-ae9e-fc25fe9dea60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:06.225447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffd715-7397-47b5-ae9e-fc25fe9dea60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:06.227141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffd715-7397-47b5-ae9e-fc25fe9dea60 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:06.247339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1325/2653] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:47:06.251565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b504b-ad49-467a-b83b-295865f3d0f0 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:06.262174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b504b-ad49-467a-b83b-295865f3d0f0 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:06.267366 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687703f2-1ff0-4699-bd1d-d3759eab4ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:06.268033 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687703f2-1ff0-4699-bd1d-d3759eab4ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:06.268310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687703f2-1ff0-4699-bd1d-d3759eab4ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:06.268655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687703f2-1ff0-4699-bd1d-d3759eab4ac9 admin admin] PATH_INFO: `/v3/projects/1d2d26a607b24974b0b9c0ae36e4408f/users/f6ade2f1797e406eaeb8ca0f797da81d/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:06.284494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687703f2-1ff0-4699-bd1d-d3759eab4ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2d26a607b24974b0b9c0ae36e4408f, user_id=f6ade2f1797e406eaeb8ca0f797da81d, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:06.287177 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687703f2-1ff0-4699-bd1d-d3759eab4ac9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:06.300679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1329/2654] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:06 2022] PUT /identity/v3/projects/1d2d26a607b24974b0b9c0ae36e4408f/users/f6ade2f1797e406eaeb8ca0f797da81d/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:06.310835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c55bc9-e73d-49f1-801e-7752e5a7841d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:06.311154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c55bc9-e73d-49f1-801e-7752e5a7841d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:06.311451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c55bc9-e73d-49f1-801e-7752e5a7841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:06.339466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a5c55bc9-e73d-49f1-801e-7752e5a7841d None None] MFA Rules not processed for user `f6ade2f1797e406eaeb8ca0f797da81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:06.340678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a5c55bc9-e73d-49f1-801e-7752e5a7841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:06.407116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1326/2655] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:06.418452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687703f2-1ff0-4699-bd1d-d3759eab4ac9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:06.420200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-687703f2-1ff0-4699-bd1d-d3759eab4ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:06.476703 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687703f2-1ff0-4699-bd1d-d3759eab4ac9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:06.480427 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aab5e-db6d-43ab-bf9c-718f178fa43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:06.481041 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aab5e-db6d-43ab-bf9c-718f178fa43c service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:06.481316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aab5e-db6d-43ab-bf9c-718f178fa43c service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:06.481580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aab5e-db6d-43ab-bf9c-718f178fa43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:06.490024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aab5e-db6d-43ab-bf9c-718f178fa43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:06.491502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aab5e-db6d-43ab-bf9c-718f178fa43c service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:06.500325 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1330/2656] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:06.746146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c55bc9-e73d-49f1-801e-7752e5a7841d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:06.747685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a5c55bc9-e73d-49f1-801e-7752e5a7841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:06.815715 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c55bc9-e73d-49f1-801e-7752e5a7841d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:06.820318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:06.820776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:06.821055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:06.821328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:06.823148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:06.898602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:06.900154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:06.912103 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1327/2657] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:10.083460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aab5e-db6d-43ab-bf9c-718f178fa43c service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:10.085018 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e55aab5e-db6d-43ab-bf9c-718f178fa43c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:10.164974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:10.167521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:10.182690 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:10.184599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08a58f-7167-4774-954f-e8009e8514f5 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:10.194624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:10.195384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:10.195824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:10.196105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] PATH_INFO: `/v3/users/d6a6f20d09bc4d5abc7c2a7fc02376b7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:10.197516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a6f20d09bc4d5abc7c2a7fc02376b7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:10.201336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:10.211446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aab5e-db6d-43ab-bf9c-718f178fa43c service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:10.220199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd028cb0-476d-47a6-9a1e-b0d1a10a0f2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:10.221051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd028cb0-476d-47a6-9a1e-b0d1a10a0f2f service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:10.221565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd028cb0-476d-47a6-9a1e-b0d1a10a0f2f service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:10.222054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd028cb0-476d-47a6-9a1e-b0d1a10a0f2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:10.224010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:DELETE=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:10.224853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd028cb0-476d-47a6-9a1e-b0d1a10a0f2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:10.240139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd028cb0-476d-47a6-9a1e-b0d1a10a0f2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:10.242077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd028cb0-476d-47a6-9a1e-b0d1a10a0f2f service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:10.253580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1331/2658] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:10.262365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a6f20d09bc4d5abc7c2a7fc02376b7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.263065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a6f20d09bc4d5abc7c2a7fc02376b7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.285464 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a6f20d09bc4d5abc7c2a7fc02376b7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.296061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a6f20d09bc4d5abc7c2a7fc02376b7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.296753 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-b09ab654-9a3a-4d98-9e84-7f648fec3fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a6f20d09bc4d5abc7c2a7fc02376b7'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.310340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1328/2659] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:10 2022] DELETE /identity/v3/users/d6a6f20d09bc4d5abc7c2a7fc02376b7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:10.492741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd028cb0-476d-47a6-9a1e-b0d1a10a0f2f service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:10.504045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd028cb0-476d-47a6-9a1e-b0d1a10a0f2f service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:10.569139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:10.569786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:10.570067 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:10.570341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] PATH_INFO: `/v3/projects/f71ff1d01f654b4a93ea43a3f18bc618` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:10.571538 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71ff1d01f654b4a93ea43a3f18bc618)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:10.573443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:10.621821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71ff1d01f654b4a93ea43a3f18bc618', 'request_id': 'req-d4d41349-3e1d-428e-bbd9-b7671b5595be'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.627411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71ff1d01f654b4a93ea43a3f18bc618', 'request_id': 'req-d4d41349-3e1d-428e-bbd9-b7671b5595be'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.634921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71ff1d01f654b4a93ea43a3f18bc618', 'request_id': 'req-d4d41349-3e1d-428e-bbd9-b7671b5595be'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.648034 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] The token cache is being invalidate because project f71ff1d01f654b4a93ea43a3f18bc618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:10.648252 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.648920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-d4d41349-3e1d-428e-bbd9-b7671b5595be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:10.650446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1332/2660] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:10 2022] DELETE /identity/v3/projects/f71ff1d01f654b4a93ea43a3f18bc618 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:10.655796 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0d60-fd75-4773-af18-1f436df61b16 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:10.656086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0d60-fd75-4773-af18-1f436df61b16 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:10.656405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0d60-fd75-4773-af18-1f436df61b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:10.677865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-109c0d60-fd75-4773-af18-1f436df61b16 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:10.679126 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-109c0d60-fd75-4773-af18-1f436df61b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:10.743946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1329/2661] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:10.752257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034faf0-9dcc-4e63-8886-579c6111f7da None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:10.752547 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034faf0-9dcc-4e63-8886-579c6111f7da None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:10.752862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034faf0-9dcc-4e63-8886-579c6111f7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:10.775751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a034faf0-9dcc-4e63-8886-579c6111f7da None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:10.776940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a034faf0-9dcc-4e63-8886-579c6111f7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:10.785835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1333/2662] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:10.790199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c0d60-fd75-4773-af18-1f436df61b16 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:10.800818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c0d60-fd75-4773-af18-1f436df61b16 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:10.806143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e087b-bae9-4c9d-af3d-f7fe0924144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:10.806770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e087b-bae9-4c9d-af3d-f7fe0924144a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:10.807080 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e087b-bae9-4c9d-af3d-f7fe0924144a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:10.807355 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e087b-bae9-4c9d-af3d-f7fe0924144a admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:10.808229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e087b-bae9-4c9d-af3d-f7fe0924144a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:47:10.808529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e087b-bae9-4c9d-af3d-f7fe0924144a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:10.810163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e087b-bae9-4c9d-af3d-f7fe0924144a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:10.822876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1330/2663] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:47:10.827283 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034faf0-9dcc-4e63-8886-579c6111f7da None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:10.838025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034faf0-9dcc-4e63-8886-579c6111f7da None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:10.843208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32732c6-b022-4f49-b07c-ef406cf3f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:10.843741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32732c6-b022-4f49-b07c-ef406cf3f703 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:10.844090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32732c6-b022-4f49-b07c-ef406cf3f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:10.845051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32732c6-b022-4f49-b07c-ef406cf3f703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:10.845470 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32732c6-b022-4f49-b07c-ef406cf3f703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:10.847845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32732c6-b022-4f49-b07c-ef406cf3f703 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:10.879132 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1334/2664] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:10 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:47:10.883622 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e087b-bae9-4c9d-af3d-f7fe0924144a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:10.909147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e087b-bae9-4c9d-af3d-f7fe0924144a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:10.981374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4782d-fdf9-4fb5-8a2a-fbb693195685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:10.982009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4782d-fdf9-4fb5-8a2a-fbb693195685 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:10.982389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4782d-fdf9-4fb5-8a2a-fbb693195685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:10.982618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4782d-fdf9-4fb5-8a2a-fbb693195685 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:10.983272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4782d-fdf9-4fb5-8a2a-fbb693195685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:10.985450 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4782d-fdf9-4fb5-8a2a-fbb693195685 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.010183 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1331/2665] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:10 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:11.014761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32732c6-b022-4f49-b07c-ef406cf3f703 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:11.029339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32732c6-b022-4f49-b07c-ef406cf3f703 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:11.034407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590b74e-b321-4136-9143-f39911fa4e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:11.035419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b74e-b321-4136-9143-f39911fa4e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.035706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b74e-b321-4136-9143-f39911fa4e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.036113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b74e-b321-4136-9143-f39911fa4e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.036828 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590b74e-b321-4136-9143-f39911fa4e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:11.038431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590b74e-b321-4136-9143-f39911fa4e92 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.050636 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1335/2666] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:11.053759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4782d-fdf9-4fb5-8a2a-fbb693195685 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:11.066451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4782d-fdf9-4fb5-8a2a-fbb693195685 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:11.072655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90d747-ee1e-40c2-9288-aedb82e49d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:11.073283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90d747-ee1e-40c2-9288-aedb82e49d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.073556 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90d747-ee1e-40c2-9288-aedb82e49d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.073821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90d747-ee1e-40c2-9288-aedb82e49d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.074515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90d747-ee1e-40c2-9288-aedb82e49d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:11.076159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90d747-ee1e-40c2-9288-aedb82e49d13 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.083268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:11.091036 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1332/2667] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:11.096353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590b74e-b321-4136-9143-f39911fa4e92 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:11.118312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590b74e-b321-4136-9143-f39911fa4e92 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:11.123273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48144b26-a07d-466d-ab69-0c9c5d26368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:11.124597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48144b26-a07d-466d-ab69-0c9c5d26368d admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.126191 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48144b26-a07d-466d-ab69-0c9c5d26368d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.126586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48144b26-a07d-466d-ab69-0c9c5d26368d admin admin] PATH_INFO: `/v3/projects/b44d35f73075425292cd4e4e0e5c47e1/users/89454c5400b041afbd8db7371fc758ca/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.144794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48144b26-a07d-466d-ab69-0c9c5d26368d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44d35f73075425292cd4e4e0e5c47e1, user_id=89454c5400b041afbd8db7371fc758ca, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:11.147534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48144b26-a07d-466d-ab69-0c9c5d26368d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.163010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1336/2668] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:11 2022] PUT /identity/v3/projects/b44d35f73075425292cd4e4e0e5c47e1/users/89454c5400b041afbd8db7371fc758ca/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:11.174838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab6d69-c40b-40f1-8aff-a6c044c9a78d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.175523 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab6d69-c40b-40f1-8aff-a6c044c9a78d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.175884 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab6d69-c40b-40f1-8aff-a6c044c9a78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.211533 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-41ab6d69-c40b-40f1-8aff-a6c044c9a78d None None] MFA Rules not processed for user `89454c5400b041afbd8db7371fc758ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:11.219159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-41ab6d69-c40b-40f1-8aff-a6c044c9a78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:11.315696 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1333/2669] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:47:11.320756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48144b26-a07d-466d-ab69-0c9c5d26368d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:11.349057 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:11.411796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48144b26-a07d-466d-ab69-0c9c5d26368d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:11.416878 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf1040-163e-42c0-8a75-a4c92d4bcefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:11.417918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1040-163e-42c0-8a75-a4c92d4bcefe admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.418299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1040-163e-42c0-8a75-a4c92d4bcefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.418792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1040-163e-42c0-8a75-a4c92d4bcefe admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.419576 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf1040-163e-42c0-8a75-a4c92d4bcefe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:11.421734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf1040-163e-42c0-8a75-a4c92d4bcefe admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.472494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1337/2670] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:11 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:47:11.476433 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab6d69-c40b-40f1-8aff-a6c044c9a78d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:11.489403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab6d69-c40b-40f1-8aff-a6c044c9a78d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:11.570011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a4d82-f748-4d43-890e-77694c6dbd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:11.570751 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a4d82-f748-4d43-890e-77694c6dbd69 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.571144 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a4d82-f748-4d43-890e-77694c6dbd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.571507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a4d82-f748-4d43-890e-77694c6dbd69 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.572209 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a4d82-f748-4d43-890e-77694c6dbd69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:11.574194 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a4d82-f748-4d43-890e-77694c6dbd69 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.598320 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1334/2671] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:11 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:47:11.602945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf1040-163e-42c0-8a75-a4c92d4bcefe admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:11.615091 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf1040-163e-42c0-8a75-a4c92d4bcefe admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:11.620662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf7b9c-aefe-4b49-80a4-f2a56464a33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:11.621534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf7b9c-aefe-4b49-80a4-f2a56464a33a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.621983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf7b9c-aefe-4b49-80a4-f2a56464a33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.622415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf7b9c-aefe-4b49-80a4-f2a56464a33a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.623378 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf7b9c-aefe-4b49-80a4-f2a56464a33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:11.625985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf7b9c-aefe-4b49-80a4-f2a56464a33a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.638394 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1338/2672] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:47:11.642935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a4d82-f748-4d43-890e-77694c6dbd69 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:11.656521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a4d82-f748-4d43-890e-77694c6dbd69 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:11.662357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905fe8f-5701-47bc-baa0-db1e08c4345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:11.664809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905fe8f-5701-47bc-baa0-db1e08c4345e admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.664809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905fe8f-5701-47bc-baa0-db1e08c4345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.664809 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905fe8f-5701-47bc-baa0-db1e08c4345e admin admin] PATH_INFO: `/v3/projects/2a50aa24c3254ae59d5a731d075fae3d/users/d6bd978561554350ab2c6dcc2289d963/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.687650 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905fe8f-5701-47bc-baa0-db1e08c4345e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a50aa24c3254ae59d5a731d075fae3d, user_id=d6bd978561554350ab2c6dcc2289d963, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:11.690367 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905fe8f-5701-47bc-baa0-db1e08c4345e admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.710658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1335/2673] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:11 2022] PUT /identity/v3/projects/2a50aa24c3254ae59d5a731d075fae3d/users/d6bd978561554350ab2c6dcc2289d963/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:11.714915 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf7b9c-aefe-4b49-80a4-f2a56464a33a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:11.745977 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf7b9c-aefe-4b49-80a4-f2a56464a33a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:11.819257 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd10638-61bf-47c7-8458-88b99168104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:11.819909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd10638-61bf-47c7-8458-88b99168104c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.820201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd10638-61bf-47c7-8458-88b99168104c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.820575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd10638-61bf-47c7-8458-88b99168104c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.821309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd10638-61bf-47c7-8458-88b99168104c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:11.823411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd10638-61bf-47c7-8458-88b99168104c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.838834 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1339/2674] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:11.843117 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905fe8f-5701-47bc-baa0-db1e08c4345e admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:11.855252 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905fe8f-5701-47bc-baa0-db1e08c4345e admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:11.860772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37f13a-8977-41f7-8a87-297dbbd1baec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:11.861506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37f13a-8977-41f7-8a87-297dbbd1baec admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.861801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37f13a-8977-41f7-8a87-297dbbd1baec admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.862124 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37f13a-8977-41f7-8a87-297dbbd1baec admin admin] PATH_INFO: `/v3/projects/2a50aa24c3254ae59d5a731d075fae3d/users/d6bd978561554350ab2c6dcc2289d963/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.865246 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37f13a-8977-41f7-8a87-297dbbd1baec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a50aa24c3254ae59d5a731d075fae3d, user_id=d6bd978561554350ab2c6dcc2289d963, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:11.868206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37f13a-8977-41f7-8a87-297dbbd1baec admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:11.881120 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1336/2675] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:11 2022] PUT /identity/v3/projects/2a50aa24c3254ae59d5a731d075fae3d/users/d6bd978561554350ab2c6dcc2289d963/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:47:11.891972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a8553-2112-44bb-9e7a-689c1fc78d17 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:11.892266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a8553-2112-44bb-9e7a-689c1fc78d17 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:11.892549 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a8553-2112-44bb-9e7a-689c1fc78d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:11.927398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-085a8553-2112-44bb-9e7a-689c1fc78d17 None None] MFA Rules not processed for user `d6bd978561554350ab2c6dcc2289d963`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:11.928594 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-085a8553-2112-44bb-9e7a-689c1fc78d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:12.006141 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1340/2676] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:12.018542 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37f13a-8977-41f7-8a87-297dbbd1baec admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:12.027429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-8c37f13a-8977-41f7-8a87-297dbbd1baec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:12.091605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:12.110358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37f13a-8977-41f7-8a87-297dbbd1baec admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:12.115732 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81e2fb-7454-426e-9c65-6917281685f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:12.116467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e2fb-7454-426e-9c65-6917281685f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:12.117039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e2fb-7454-426e-9c65-6917281685f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:12.117383 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e2fb-7454-426e-9c65-6917281685f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:12.128940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e2fb-7454-426e-9c65-6917281685f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:12.130380 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e2fb-7454-426e-9c65-6917281685f7 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:12.140848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1337/2677] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:12.664876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a8553-2112-44bb-9e7a-689c1fc78d17 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:12.687131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:12.775565 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a8553-2112-44bb-9e7a-689c1fc78d17 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:12.784727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:12.785425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:12.785706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:12.785976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] PATH_INFO: `/v3/users/89454c5400b041afbd8db7371fc758ca` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:12.787298 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=89454c5400b041afbd8db7371fc758ca)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:12.789529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:12.859163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89454c5400b041afbd8db7371fc758ca'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:12.860140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89454c5400b041afbd8db7371fc758ca'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:12.879064 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89454c5400b041afbd8db7371fc758ca'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:12.896120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89454c5400b041afbd8db7371fc758ca'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:12.910165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89454c5400b041afbd8db7371fc758ca'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:12.923090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1341/2678] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:12 2022] DELETE /identity/v3/users/89454c5400b041afbd8db7371fc758ca => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:12.925461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd5d69-74d1-4a3a-85f4-1f6dc118eab2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:12.926647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd5d69-74d1-4a3a-85f4-1f6dc118eab2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:12.927135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd5d69-74d1-4a3a-85f4-1f6dc118eab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:12.952687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a9cd5d69-74d1-4a3a-85f4-1f6dc118eab2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:12.954467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a9cd5d69-74d1-4a3a-85f4-1f6dc118eab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:13.034584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1338/2679] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:13.041749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:13.044331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:13.128958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8923ee7-8f47-418e-ba47-0c764527f1cc admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:13.132866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54f88c-c807-4e86-a32c-4d849453cc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:13.133493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54f88c-c807-4e86-a32c-4d849453cc35 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:13.133773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54f88c-c807-4e86-a32c-4d849453cc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:13.134044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54f88c-c807-4e86-a32c-4d849453cc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:13.145765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54f88c-c807-4e86-a32c-4d849453cc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:13.147280 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54f88c-c807-4e86-a32c-4d849453cc35 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:13.166051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1342/2680] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:13.383686 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180891f9-ab3f-4355-855f-2c66dc354f1f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:13.384458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180891f9-ab3f-4355-855f-2c66dc354f1f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:13.385601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180891f9-ab3f-4355-855f-2c66dc354f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:13.412378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-180891f9-ab3f-4355-855f-2c66dc354f1f None None] MFA Rules not processed for user `54eecc3a8e054a0bbe0fd68e1aa85238`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:13.414048 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-180891f9-ab3f-4355-855f-2c66dc354f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:13.497272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1339/2681] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:47:13.670884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54f88c-c807-4e86-a32c-4d849453cc35 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:13.673121 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fe54f88c-c807-4e86-a32c-4d849453cc35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:13.689729 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54f88c-c807-4e86-a32c-4d849453cc35 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:13.696824 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:13.697488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:13.699383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:13.699906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] PATH_INFO: `/v3/projects/b44d35f73075425292cd4e4e0e5c47e1` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:13.701657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44d35f73075425292cd4e4e0e5c47e1)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:13.703971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:13.744175 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:13.767416 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44d35f73075425292cd4e4e0e5c47e1', 'request_id': 'req-05daf478-7091-40a4-8071-855758a2a77e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.775152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44d35f73075425292cd4e4e0e5c47e1', 'request_id': 'req-05daf478-7091-40a4-8071-855758a2a77e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.783625 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44d35f73075425292cd4e4e0e5c47e1', 'request_id': 'req-05daf478-7091-40a4-8071-855758a2a77e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.796441 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] The token cache is being invalidate because project b44d35f73075425292cd4e4e0e5c47e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:13.796753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.797903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.799654 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1343/2682] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:13 2022] DELETE /identity/v3/projects/b44d35f73075425292cd4e4e0e5c47e1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:13.804515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180891f9-ab3f-4355-855f-2c66dc354f1f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:13.819148 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180891f9-ab3f-4355-855f-2c66dc354f1f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:13.883816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:13.884465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:13.884744 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:13.885040 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] PATH_INFO: `/v3/users/d6bd978561554350ab2c6dcc2289d963` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:13.886251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bd978561554350ab2c6dcc2289d963)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:13.888199 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:13.901136 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:13.903398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:13.928171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:13.943518 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bd978561554350ab2c6dcc2289d963'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.944260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bd978561554350ab2c6dcc2289d963'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.957134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bd978561554350ab2c6dcc2289d963'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.965647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bd978561554350ab2c6dcc2289d963'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.966291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bd978561554350ab2c6dcc2289d963'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:13.970817 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daf478-7091-40a4-8071-855758a2a77e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:13.975300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12f84e-4927-4405-a50b-676010c9f3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:13.975862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12f84e-4927-4405-a50b-676010c9f3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:13.976309 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12f84e-4927-4405-a50b-676010c9f3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:13.976606 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12f84e-4927-4405-a50b-676010c9f3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:13.979047 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ed12f84e-4927-4405-a50b-676010c9f3e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:13.980244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1340/2683] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:13 2022] DELETE /identity/v3/users/d6bd978561554350ab2c6dcc2289d963 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:47:13.990221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12f84e-4927-4405-a50b-676010c9f3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:13.991815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12f84e-4927-4405-a50b-676010c9f3e2 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:14.002237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1344/2684] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:47:14.427973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:14.429624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:14.527950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acb319-58ec-44cf-88aa-5d05b40c0af4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:14.533854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:14.534552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:14.534837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:14.535313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] PATH_INFO: `/v3/projects/2a50aa24c3254ae59d5a731d075fae3d` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:14.536451 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a50aa24c3254ae59d5a731d075fae3d)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:14.538365 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:14.586095 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a50aa24c3254ae59d5a731d075fae3d', 'request_id': 'req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:14.591915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a50aa24c3254ae59d5a731d075fae3d', 'request_id': 'req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:14.601269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a50aa24c3254ae59d5a731d075fae3d', 'request_id': 'req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:14.612845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] The token cache is being invalidate because project 2a50aa24c3254ae59d5a731d075fae3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:14.613130 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:14.613776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-c4efe9d0-5423-4ed1-8363-13e4334c8fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:14.615331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1341/2685] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:14 2022] DELETE /identity/v3/projects/2a50aa24c3254ae59d5a731d075fae3d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:14.621481 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161031-a224-40a7-9d8f-caf3cbb0b48a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:14.621855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161031-a224-40a7-9d8f-caf3cbb0b48a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:14.622043 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161031-a224-40a7-9d8f-caf3cbb0b48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:14.643070 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-75161031-a224-40a7-9d8f-caf3cbb0b48a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:14.644468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-75161031-a224-40a7-9d8f-caf3cbb0b48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:14.725037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1345/2686] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:14.727659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408198-e0c4-4740-ba29-54fe6808861f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:14.727942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408198-e0c4-4740-ba29-54fe6808861f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:14.728690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408198-e0c4-4740-ba29-54fe6808861f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:14.755363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-32408198-e0c4-4740-ba29-54fe6808861f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:14.756599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-32408198-e0c4-4740-ba29-54fe6808861f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:14.774170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1342/2687] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:14.780154 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161031-a224-40a7-9d8f-caf3cbb0b48a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:14.790499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161031-a224-40a7-9d8f-caf3cbb0b48a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:14.795598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851d2c-c237-437f-a894-6a48854e195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:14.796219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851d2c-c237-437f-a894-6a48854e195e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:14.796562 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851d2c-c237-437f-a894-6a48854e195e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:14.796876 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c851d2c-c237-437f-a894-6a48854e195e admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:14.797607 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851d2c-c237-437f-a894-6a48854e195e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:47:14.797912 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851d2c-c237-437f-a894-6a48854e195e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:14.799898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c851d2c-c237-437f-a894-6a48854e195e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:14.815458 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1346/2688] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:47:14.818045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408198-e0c4-4740-ba29-54fe6808861f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:14.828063 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408198-e0c4-4740-ba29-54fe6808861f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:14.836586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6958d-9e7a-484b-b8e1-cc1d031da578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:14.837417 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6958d-9e7a-484b-b8e1-cc1d031da578 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:14.837917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6958d-9e7a-484b-b8e1-cc1d031da578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:14.838198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6958d-9e7a-484b-b8e1-cc1d031da578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:14.838940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6958d-9e7a-484b-b8e1-cc1d031da578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:14.840885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6958d-9e7a-484b-b8e1-cc1d031da578 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:14.872480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1343/2689] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:14 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:14.884052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851d2c-c237-437f-a894-6a48854e195e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:14.894773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c851d2c-c237-437f-a894-6a48854e195e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:14.948917 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:14.968124 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e007ad-d45e-4fd9-b78b-d3b394adc08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:14.968815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e007ad-d45e-4fd9-b78b-d3b394adc08c admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:14.969626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e007ad-d45e-4fd9-b78b-d3b394adc08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:14.969899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e007ad-d45e-4fd9-b78b-d3b394adc08c admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:14.970627 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e007ad-d45e-4fd9-b78b-d3b394adc08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:14.972580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e007ad-d45e-4fd9-b78b-d3b394adc08c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:14.996181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1347/2690] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:14 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:47:15.000463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6958d-9e7a-484b-b8e1-cc1d031da578 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.010874 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6958d-9e7a-484b-b8e1-cc1d031da578 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.015711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ccd3c-6126-45b6-93d0-b0682433ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.016328 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ccd3c-6126-45b6-93d0-b0682433ef3b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.016611 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ccd3c-6126-45b6-93d0-b0682433ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.016888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ccd3c-6126-45b6-93d0-b0682433ef3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.017586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ccd3c-6126-45b6-93d0-b0682433ef3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.019227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ccd3c-6126-45b6-93d0-b0682433ef3b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.026153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:15.037413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e007ad-d45e-4fd9-b78b-d3b394adc08c admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.037740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1344/2691] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:15.048806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e007ad-d45e-4fd9-b78b-d3b394adc08c admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.054637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c643af-d684-4997-aee8-c7102a6f6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.055368 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c643af-d684-4997-aee8-c7102a6f6d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.055647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c643af-d684-4997-aee8-c7102a6f6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.055920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c643af-d684-4997-aee8-c7102a6f6d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.056615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c643af-d684-4997-aee8-c7102a6f6d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.058895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c643af-d684-4997-aee8-c7102a6f6d1a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.070833 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1348/2692] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:15.075384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ccd3c-6126-45b6-93d0-b0682433ef3b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.086840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ccd3c-6126-45b6-93d0-b0682433ef3b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.092000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b7dd8-a881-49c2-bde9-0290d5707112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.092805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7dd8-a881-49c2-bde9-0290d5707112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.093093 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7dd8-a881-49c2-bde9-0290d5707112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.093382 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7dd8-a881-49c2-bde9-0290d5707112 admin admin] PATH_INFO: `/v3/projects/cacdb8870e344ac6aff189d1ab5270d6/users/c03e39b1a86341688c4f4ec958c3d415/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.109431 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b7dd8-a881-49c2-bde9-0290d5707112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacdb8870e344ac6aff189d1ab5270d6, user_id=c03e39b1a86341688c4f4ec958c3d415, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.112146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b7dd8-a881-49c2-bde9-0290d5707112 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.124600 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1345/2693] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:15 2022] PUT /identity/v3/projects/cacdb8870e344ac6aff189d1ab5270d6/users/c03e39b1a86341688c4f4ec958c3d415/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:15.135265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2406d0-2845-4532-b5aa-68fe4f05054c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.135550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2406d0-2845-4532-b5aa-68fe4f05054c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.135825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2406d0-2845-4532-b5aa-68fe4f05054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.165450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-3a2406d0-2845-4532-b5aa-68fe4f05054c None None] MFA Rules not processed for user `c03e39b1a86341688c4f4ec958c3d415`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:15.166662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3a2406d0-2845-4532-b5aa-68fe4f05054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:15.230461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1349/2694] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:15.235337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b7dd8-a881-49c2-bde9-0290d5707112 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.299097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b7dd8-a881-49c2-bde9-0290d5707112 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.303986 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88d580-8afc-4948-aec2-733996b0389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.304602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88d580-8afc-4948-aec2-733996b0389c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.304903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88d580-8afc-4948-aec2-733996b0389c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.305191 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88d580-8afc-4948-aec2-733996b0389c admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.305848 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88d580-8afc-4948-aec2-733996b0389c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.307789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88d580-8afc-4948-aec2-733996b0389c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.335313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1346/2695] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:15 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:15.339512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2406d0-2845-4532-b5aa-68fe4f05054c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.351130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2406d0-2845-4532-b5aa-68fe4f05054c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.409812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdd5ff-dac0-42ff-b812-d2143e83d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.410443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdd5ff-dac0-42ff-b812-d2143e83d159 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.410741 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdd5ff-dac0-42ff-b812-d2143e83d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.411017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdd5ff-dac0-42ff-b812-d2143e83d159 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.411678 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdd5ff-dac0-42ff-b812-d2143e83d159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.413693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdd5ff-dac0-42ff-b812-d2143e83d159 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.439095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1350/2696] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:15 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:15.443146 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88d580-8afc-4948-aec2-733996b0389c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.455310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88d580-8afc-4948-aec2-733996b0389c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.460161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716a00c-acbb-4303-ab5a-bc5757875907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.460805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716a00c-acbb-4303-ab5a-bc5757875907 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.461069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716a00c-acbb-4303-ab5a-bc5757875907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.461347 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716a00c-acbb-4303-ab5a-bc5757875907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.462053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716a00c-acbb-4303-ab5a-bc5757875907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.463716 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716a00c-acbb-4303-ab5a-bc5757875907 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.476952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1347/2697] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:15.481507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdd5ff-dac0-42ff-b812-d2143e83d159 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.495235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdd5ff-dac0-42ff-b812-d2143e83d159 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.500677 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3b95-9f5f-4b4b-8f3c-ed526993ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.501383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3b95-9f5f-4b4b-8f3c-ed526993ac8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.501662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3b95-9f5f-4b4b-8f3c-ed526993ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.501990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3b95-9f5f-4b4b-8f3c-ed526993ac8f admin admin] PATH_INFO: `/v3/projects/d579b6c913a24e1e8321ace1d5ff63fa/users/4ff66df082b941f3bb5926c1fac5d6d0/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.524167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c3b95-9f5f-4b4b-8f3c-ed526993ac8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d579b6c913a24e1e8321ace1d5ff63fa, user_id=4ff66df082b941f3bb5926c1fac5d6d0, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.527454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c3b95-9f5f-4b4b-8f3c-ed526993ac8f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.555875 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1351/2698] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:15 2022] PUT /identity/v3/projects/d579b6c913a24e1e8321ace1d5ff63fa/users/4ff66df082b941f3bb5926c1fac5d6d0/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:15.559998 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716a00c-acbb-4303-ab5a-bc5757875907 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.576208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716a00c-acbb-4303-ab5a-bc5757875907 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.660545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc87b7-0275-4cca-9b71-5985824660ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.661177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc87b7-0275-4cca-9b71-5985824660ac admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.661498 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc87b7-0275-4cca-9b71-5985824660ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.661736 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc87b7-0275-4cca-9b71-5985824660ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.662568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc87b7-0275-4cca-9b71-5985824660ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.664227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc87b7-0275-4cca-9b71-5985824660ac admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.675026 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1348/2699] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:15.678841 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3b95-9f5f-4b4b-8f3c-ed526993ac8f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.690704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3b95-9f5f-4b4b-8f3c-ed526993ac8f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.695747 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a770-4e5d-4169-9414-ebacdfbc3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.696505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a770-4e5d-4169-9414-ebacdfbc3f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.696862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a770-4e5d-4169-9414-ebacdfbc3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.697207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a770-4e5d-4169-9414-ebacdfbc3f5f admin admin] PATH_INFO: `/v3/projects/d579b6c913a24e1e8321ace1d5ff63fa/users/4ff66df082b941f3bb5926c1fac5d6d0/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.699402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a770-4e5d-4169-9414-ebacdfbc3f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d579b6c913a24e1e8321ace1d5ff63fa, user_id=4ff66df082b941f3bb5926c1fac5d6d0, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.702345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a770-4e5d-4169-9414-ebacdfbc3f5f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.714724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1352/2700] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:15 2022] PUT /identity/v3/projects/d579b6c913a24e1e8321ace1d5ff63fa/users/4ff66df082b941f3bb5926c1fac5d6d0/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:15.726680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c5489-28ec-4107-b6bc-ab3ad5a7c499 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.726971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c5489-28ec-4107-b6bc-ab3ad5a7c499 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.727923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c5489-28ec-4107-b6bc-ab3ad5a7c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.757808 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-aa7c5489-28ec-4107-b6bc-ab3ad5a7c499 None None] MFA Rules not processed for user `4ff66df082b941f3bb5926c1fac5d6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:15.759041 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-aa7c5489-28ec-4107-b6bc-ab3ad5a7c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:15.795260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:15.835270 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1349/2701] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:15.847803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a770-4e5d-4169-9414-ebacdfbc3f5f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:15.850593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-44a8a770-4e5d-4169-9414-ebacdfbc3f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:15.857345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:15.916233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a770-4e5d-4169-9414-ebacdfbc3f5f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:15.919537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485294dc-dc9f-4460-a70c-cbbe5ef40025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:15.921051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485294dc-dc9f-4460-a70c-cbbe5ef40025 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:15.921051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485294dc-dc9f-4460-a70c-cbbe5ef40025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:15.921051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485294dc-dc9f-4460-a70c-cbbe5ef40025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:15.931341 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485294dc-dc9f-4460-a70c-cbbe5ef40025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:15.932788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485294dc-dc9f-4460-a70c-cbbe5ef40025 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:15.944444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1353/2702] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:16.337110 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c5489-28ec-4107-b6bc-ab3ad5a7c499 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:16.347555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c5489-28ec-4107-b6bc-ab3ad5a7c499 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:16.352305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ae2eb-850a-4c18-a44f-11f4373599f9 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff66df082b941f3bb5926c1fac5d6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd579b6c913a24e1e8321ace1d5ff63fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:16.352971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ae2eb-850a-4c18-a44f-11f4373599f9 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:16.353313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ae2eb-850a-4c18-a44f-11f4373599f9 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:16.353649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ae2eb-850a-4c18-a44f-11f4373599f9 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:16.354414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ae2eb-850a-4c18-a44f-11f4373599f9 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:47:16.354793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ae2eb-850a-4c18-a44f-11f4373599f9 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:16.356497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ae2eb-850a-4c18-a44f-11f4373599f9 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:16.369688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1350/2703] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:47:16.373938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485294dc-dc9f-4460-a70c-cbbe5ef40025 service cinder] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:16.387231 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485294dc-dc9f-4460-a70c-cbbe5ef40025 service cinder] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:16.392433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685a7f9-d79d-4325-a84e-e05cd0d4a6b7 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff66df082b941f3bb5926c1fac5d6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd579b6c913a24e1e8321ace1d5ff63fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:16.393299 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685a7f9-d79d-4325-a84e-e05cd0d4a6b7 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:16.393723 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685a7f9-d79d-4325-a84e-e05cd0d4a6b7 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:16.394249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685a7f9-d79d-4325-a84e-e05cd0d4a6b7 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:16.395123 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685a7f9-d79d-4325-a84e-e05cd0d4a6b7 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:16.397272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685a7f9-d79d-4325-a84e-e05cd0d4a6b7 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:16.425901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1354/2704] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:16 2022] POST /identity/v3/projects => generated 354 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:16.430163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ae2eb-850a-4c18-a44f-11f4373599f9 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:16.440561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ae2eb-850a-4c18-a44f-11f4373599f9 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:16.506058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff66df082b941f3bb5926c1fac5d6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd579b6c913a24e1e8321ace1d5ff63fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:16.506740 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:16.507578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:16.507866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:16.508669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:47:16.509242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:16.511014 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:16.523360 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1351/2705] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:47:16.563036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685a7f9-d79d-4325-a84e-e05cd0d4a6b7 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:16.573383 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685a7f9-d79d-4325-a84e-e05cd0d4a6b7 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:16.578084 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ff66df082b941f3bb5926c1fac5d6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd579b6c913a24e1e8321ace1d5ff63fa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:16.579302 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:16.579584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:16.579900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] PATH_INFO: `/v3/projects/f569f265d6084500bb859591f21bfdaf` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:16.581038 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f569f265d6084500bb859591f21bfdaf)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:16.582940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:16.632119 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f569f265d6084500bb859591f21bfdaf', 'request_id': 'req-40618e7d-2258-4e81-9500-882529ba2367'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:16.637949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f569f265d6084500bb859591f21bfdaf', 'request_id': 'req-40618e7d-2258-4e81-9500-882529ba2367'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:16.645832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f569f265d6084500bb859591f21bfdaf', 'request_id': 'req-40618e7d-2258-4e81-9500-882529ba2367'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:16.657666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] The token cache is being invalidate because project f569f265d6084500bb859591f21bfdaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:16.657847 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:16.658733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:16.660296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1355/2706] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:16 2022] DELETE /identity/v3/projects/f569f265d6084500bb859591f21bfdaf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:47:16.927684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:16.931242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:17.010331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6528ea-61cf-4203-9381-4929a6324d81 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:17.064715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:17.066199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:17.073878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:17.074552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:17.074803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:17.075118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] PATH_INFO: `/v3/users/c03e39b1a86341688c4f4ec958c3d415` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:17.077852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03e39b1a86341688c4f4ec958c3d415)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:17.079920 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:17.081929 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:17.136163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03e39b1a86341688c4f4ec958c3d415'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.136727 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03e39b1a86341688c4f4ec958c3d415'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.145613 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40618e7d-2258-4e81-9500-882529ba2367 tempest-VolumeQuotaClassesTest-6170091 tempest-VolumeQuotaClassesTest-6170091-project-admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:17.151218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03e39b1a86341688c4f4ec958c3d415'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.152666 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:17.153410 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:17.153812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:17.154164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] PATH_INFO: `/v3/users/f6ade2f1797e406eaeb8ca0f797da81d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:17.155468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ade2f1797e406eaeb8ca0f797da81d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:17.158604 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:17.160950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03e39b1a86341688c4f4ec958c3d415'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.161767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-482ac7bf-8b76-48de-805f-85df0f14be32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03e39b1a86341688c4f4ec958c3d415'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.170415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:17.177582 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1352/2707] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:16 2022] DELETE /identity/v3/users/c03e39b1a86341688c4f4ec958c3d415 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:17.182759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc4bd9-c5df-4250-94d2-f925b507c4f2 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:17.183343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc4bd9-c5df-4250-94d2-f925b507c4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:17.183814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc4bd9-c5df-4250-94d2-f925b507c4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:17.208790 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b5fc4bd9-c5df-4250-94d2-f925b507c4f2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:17.210009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b5fc4bd9-c5df-4250-94d2-f925b507c4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:17.228109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ade2f1797e406eaeb8ca0f797da81d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.229358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ade2f1797e406eaeb8ca0f797da81d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.247903 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ade2f1797e406eaeb8ca0f797da81d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.258249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ade2f1797e406eaeb8ca0f797da81d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.270426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9a47dae6-4ec7-4940-ba5c-9c6a6e6e6c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ade2f1797e406eaeb8ca0f797da81d'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.278949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1356/2708] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:17 2022] DELETE /identity/v3/users/f6ade2f1797e406eaeb8ca0f797da81d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:47:17.283776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddf293-e9ff-43fc-990b-a462dcebd34d None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:17.283937 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1353/2709] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:17.284095 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddf293-e9ff-43fc-990b-a462dcebd34d None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:17.284398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddf293-e9ff-43fc-990b-a462dcebd34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:17.294087 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc4bd9-c5df-4250-94d2-f925b507c4f2 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:17.295587 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b5fc4bd9-c5df-4250-94d2-f925b507c4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:17.305567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-7eddf293-e9ff-43fc-990b-a462dcebd34d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:17.306797 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-7eddf293-e9ff-43fc-990b-a462dcebd34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:17.361494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc4bd9-c5df-4250-94d2-f925b507c4f2 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:17.375913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1357/2710] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:47:17.385979 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddf293-e9ff-43fc-990b-a462dcebd34d None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:17.402406 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:17.429594 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a887a-9452-4a0b-ac17-5030dd62bc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:17.430222 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a887a-9452-4a0b-ac17-5030dd62bc14 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:17.430497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a887a-9452-4a0b-ac17-5030dd62bc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:17.430769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a887a-9452-4a0b-ac17-5030dd62bc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:17.441439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a887a-9452-4a0b-ac17-5030dd62bc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:17.442876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a887a-9452-4a0b-ac17-5030dd62bc14 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:17.453957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1354/2711] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:47:17.463976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddf293-e9ff-43fc-990b-a462dcebd34d None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:17.467853 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328164-3dd2-4645-beb3-639e31d9d9df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:17.468477 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328164-3dd2-4645-beb3-639e31d9d9df service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:17.468809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328164-3dd2-4645-beb3-639e31d9d9df service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:17.469579 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328164-3dd2-4645-beb3-639e31d9d9df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:17.481542 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82328164-3dd2-4645-beb3-639e31d9d9df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:17.483015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82328164-3dd2-4645-beb3-639e31d9d9df service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:17.494688 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1358/2712] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:47:17.841179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a887a-9452-4a0b-ac17-5030dd62bc14 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:17.842678 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3a2a887a-9452-4a0b-ac17-5030dd62bc14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:17.856024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a887a-9452-4a0b-ac17-5030dd62bc14 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:17.861375 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:17.862023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:17.862301 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:17.863037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] PATH_INFO: `/v3/projects/cacdb8870e344ac6aff189d1ab5270d6` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:17.863847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cacdb8870e344ac6aff189d1ab5270d6)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:17.865742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:17.924903 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cacdb8870e344ac6aff189d1ab5270d6', 'request_id': 'req-87a49aca-396a-49b0-b41b-c9ee003fac74'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.935340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cacdb8870e344ac6aff189d1ab5270d6', 'request_id': 'req-87a49aca-396a-49b0-b41b-c9ee003fac74'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.940533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328164-3dd2-4645-beb3-639e31d9d9df service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:17.942057 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-82328164-3dd2-4645-beb3-639e31d9d9df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:17.949391 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cacdb8870e344ac6aff189d1ab5270d6', 'request_id': 'req-87a49aca-396a-49b0-b41b-c9ee003fac74'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.959046 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328164-3dd2-4645-beb3-639e31d9d9df service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:17.965627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] The token cache is being invalidate because project cacdb8870e344ac6aff189d1ab5270d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:17.966112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.967024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:17.968821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1355/2713] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:17 2022] DELETE /identity/v3/projects/cacdb8870e344ac6aff189d1ab5270d6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:17.972578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:17.975599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:18.002557 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:18.043792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:18.044873 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:18.045536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:18.045909 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] PATH_INFO: `/v3/projects/1d2d26a607b24974b0b9c0ae36e4408f` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:18.048029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2d26a607b24974b0b9c0ae36e4408f)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:18.050125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:18.072527 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a49aca-396a-49b0-b41b-c9ee003fac74 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:18.077961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:18.079342 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:18.079745 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:18.080086 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] PATH_INFO: `/v3/users/4ff66df082b941f3bb5926c1fac5d6d0` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:18.081361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff66df082b941f3bb5926c1fac5d6d0)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:18.083435 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:18.108244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2d26a607b24974b0b9c0ae36e4408f', 'request_id': 'req-9d524b3b-412e-4a61-ae41-641343dd61b3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.114921 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2d26a607b24974b0b9c0ae36e4408f', 'request_id': 'req-9d524b3b-412e-4a61-ae41-641343dd61b3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.127613 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2d26a607b24974b0b9c0ae36e4408f', 'request_id': 'req-9d524b3b-412e-4a61-ae41-641343dd61b3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.141000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] The token cache is being invalidate because project 1d2d26a607b24974b0b9c0ae36e4408f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:18.141395 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff66df082b941f3bb5926c1fac5d6d0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.141516 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.142075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff66df082b941f3bb5926c1fac5d6d0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.142414 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.144101 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1359/2714] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:17 2022] DELETE /identity/v3/projects/1d2d26a607b24974b0b9c0ae36e4408f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:47:18.157926 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:18.159983 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff66df082b941f3bb5926c1fac5d6d0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.168888 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff66df082b941f3bb5926c1fac5d6d0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.169561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-fd5a4c7d-539c-48cb-9c55-7d996b4a7b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff66df082b941f3bb5926c1fac5d6d0'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.186442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1356/2715] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:17 2022] DELETE /identity/v3/users/4ff66df082b941f3bb5926c1fac5d6d0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:47:18.512835 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:18.516588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:18.605813 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524b3b-412e-4a61-ae41-641343dd61b3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:18.673606 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:18.674265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:18.675157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:18.675460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] PATH_INFO: `/v3/projects/d579b6c913a24e1e8321ace1d5ff63fa` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:18.676639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d579b6c913a24e1e8321ace1d5ff63fa)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:18.678553 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:18.691353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:18.743924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd579b6c913a24e1e8321ace1d5ff63fa', 'request_id': 'req-1b578222-a3b1-4160-a51a-bfb987876f95'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.750300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd579b6c913a24e1e8321ace1d5ff63fa', 'request_id': 'req-1b578222-a3b1-4160-a51a-bfb987876f95'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.761025 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd579b6c913a24e1e8321ace1d5ff63fa', 'request_id': 'req-1b578222-a3b1-4160-a51a-bfb987876f95'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.773114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] The token cache is being invalidate because project d579b6c913a24e1e8321ace1d5ff63fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:18.773422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.774158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-1b578222-a3b1-4160-a51a-bfb987876f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:18.775731 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1360/2716] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:18 2022] DELETE /identity/v3/projects/d579b6c913a24e1e8321ace1d5ff63fa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:18.780957 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f8a6-d097-43d5-8aad-4fe9a9a9c41a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:18.782359 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f8a6-d097-43d5-8aad-4fe9a9a9c41a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:18.782643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f8a6-d097-43d5-8aad-4fe9a9a9c41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:18.803268 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-1d82f8a6-d097-43d5-8aad-4fe9a9a9c41a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:18.804491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-1d82f8a6-d097-43d5-8aad-4fe9a9a9c41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:18.864033 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1357/2717] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:18.872085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00770e76-3eab-4c93-abb3-c5454b7c9e73 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:18.872373 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00770e76-3eab-4c93-abb3-c5454b7c9e73 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:18.872646 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00770e76-3eab-4c93-abb3-c5454b7c9e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:18.893027 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-00770e76-3eab-4c93-abb3-c5454b7c9e73 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:18.894236 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-00770e76-3eab-4c93-abb3-c5454b7c9e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:18.902190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1361/2718] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:18.906620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f8a6-d097-43d5-8aad-4fe9a9a9c41a None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:18.916854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f8a6-d097-43d5-8aad-4fe9a9a9c41a None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:18.921607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1693-f322-4f97-994b-6e442ffd711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:18.922776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1693-f322-4f97-994b-6e442ffd711b admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:18.923085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1693-f322-4f97-994b-6e442ffd711b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:18.923357 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1693-f322-4f97-994b-6e442ffd711b admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:18.924051 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1693-f322-4f97-994b-6e442ffd711b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:47:18.924356 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1693-f322-4f97-994b-6e442ffd711b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:18.925942 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1693-f322-4f97-994b-6e442ffd711b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:18.938318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1358/2719] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:47:18.942770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00770e76-3eab-4c93-abb3-c5454b7c9e73 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:18.952432 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00770e76-3eab-4c93-abb3-c5454b7c9e73 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:18.957111 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d7ae-2515-4a09-89d0-2ccfd81a8ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:18.957725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d7ae-2515-4a09-89d0-2ccfd81a8ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:18.958003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d7ae-2515-4a09-89d0-2ccfd81a8ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:18.958273 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d7ae-2515-4a09-89d0-2ccfd81a8ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:18.958973 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d7ae-2515-4a09-89d0-2ccfd81a8ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:18.961099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d7ae-2515-4a09-89d0-2ccfd81a8ae3 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:18.991420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1362/2720] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:18 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:18.996388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1693-f322-4f97-994b-6e442ffd711b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.007311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1693-f322-4f97-994b-6e442ffd711b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.066486 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb990c9-a5c5-40f0-b92d-d4d64a8e3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.067153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb990c9-a5c5-40f0-b92d-d4d64a8e3e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.067439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb990c9-a5c5-40f0-b92d-d4d64a8e3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.067713 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb990c9-a5c5-40f0-b92d-d4d64a8e3e7c admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.068412 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb990c9-a5c5-40f0-b92d-d4d64a8e3e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.070400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb990c9-a5c5-40f0-b92d-d4d64a8e3e7c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.093826 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1359/2721] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:18 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:19.097662 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d7ae-2515-4a09-89d0-2ccfd81a8ae3 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.108568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d7ae-2515-4a09-89d0-2ccfd81a8ae3 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.113988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495dca5-bf8d-4a17-a660-d6c86579f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.115021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495dca5-bf8d-4a17-a660-d6c86579f833 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.115021 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495dca5-bf8d-4a17-a660-d6c86579f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.115310 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495dca5-bf8d-4a17-a660-d6c86579f833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.116090 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495dca5-bf8d-4a17-a660-d6c86579f833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.118351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495dca5-bf8d-4a17-a660-d6c86579f833 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.130044 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1363/2722] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:19.134024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb990c9-a5c5-40f0-b92d-d4d64a8e3e7c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.144031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb990c9-a5c5-40f0-b92d-d4d64a8e3e7c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.148524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37697e-9994-4dc1-9723-2c1ecf4d6c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.149132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37697e-9994-4dc1-9723-2c1ecf4d6c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.149408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37697e-9994-4dc1-9723-2c1ecf4d6c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.149680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37697e-9994-4dc1-9723-2c1ecf4d6c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.150372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37697e-9994-4dc1-9723-2c1ecf4d6c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.152002 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37697e-9994-4dc1-9723-2c1ecf4d6c8a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.163472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1360/2723] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:47:19.167631 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495dca5-bf8d-4a17-a660-d6c86579f833 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.178655 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495dca5-bf8d-4a17-a660-d6c86579f833 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.185673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7992b7-6d64-4896-a805-c4f31304975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.186348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7992b7-6d64-4896-a805-c4f31304975f admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.186623 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7992b7-6d64-4896-a805-c4f31304975f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.186891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7992b7-6d64-4896-a805-c4f31304975f admin admin] PATH_INFO: `/v3/projects/b0b0356b3ea647e3b189f3ffab1a0391/users/6b00b672ec64430c87800d2ee692ebb9/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.204796 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7992b7-6d64-4896-a805-c4f31304975f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b0356b3ea647e3b189f3ffab1a0391, user_id=6b00b672ec64430c87800d2ee692ebb9, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.207633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7992b7-6d64-4896-a805-c4f31304975f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.222445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1364/2724] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:19 2022] PUT /identity/v3/projects/b0b0356b3ea647e3b189f3ffab1a0391/users/6b00b672ec64430c87800d2ee692ebb9/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:19.233057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b616-b697-4f45-b33e-819fc076aa15 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.233276 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b616-b697-4f45-b33e-819fc076aa15 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.233553 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b616-b697-4f45-b33e-819fc076aa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.269320 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-2093b616-b697-4f45-b33e-819fc076aa15 None None] MFA Rules not processed for user `6b00b672ec64430c87800d2ee692ebb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:19.270544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-2093b616-b697-4f45-b33e-819fc076aa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:19.308393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:19.340654 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1361/2725] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:19.345905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7992b7-6d64-4896-a805-c4f31304975f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.406877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7992b7-6d64-4896-a805-c4f31304975f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.411807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4b222-56e7-408c-8439-f05c248860d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.412421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4b222-56e7-408c-8439-f05c248860d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.412701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4b222-56e7-408c-8439-f05c248860d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.412974 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4b222-56e7-408c-8439-f05c248860d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.413629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4b222-56e7-408c-8439-f05c248860d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.415555 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4b222-56e7-408c-8439-f05c248860d9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.441960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1365/2726] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:19 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:19.446166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b616-b697-4f45-b33e-819fc076aa15 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.457022 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b616-b697-4f45-b33e-819fc076aa15 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.513078 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0341d-3a72-4ea8-8f16-3e5de70c30e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.513609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0341d-3a72-4ea8-8f16-3e5de70c30e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.513885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0341d-3a72-4ea8-8f16-3e5de70c30e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.514157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0341d-3a72-4ea8-8f16-3e5de70c30e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.514832 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0341d-3a72-4ea8-8f16-3e5de70c30e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.516791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0341d-3a72-4ea8-8f16-3e5de70c30e5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.541422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1362/2727] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:19 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:47:19.545845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4b222-56e7-408c-8439-f05c248860d9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.557314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4b222-56e7-408c-8439-f05c248860d9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.561958 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e601496-029d-4ff4-94e1-d606cbe5305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.562587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e601496-029d-4ff4-94e1-d606cbe5305e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.562867 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e601496-029d-4ff4-94e1-d606cbe5305e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.563173 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e601496-029d-4ff4-94e1-d606cbe5305e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.563868 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e601496-029d-4ff4-94e1-d606cbe5305e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.565447 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e601496-029d-4ff4-94e1-d606cbe5305e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.576098 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1366/2728] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:19.580902 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0341d-3a72-4ea8-8f16-3e5de70c30e5 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.591211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0341d-3a72-4ea8-8f16-3e5de70c30e5 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.596633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f14d0-384a-452b-adde-b39067d1c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.597291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f14d0-384a-452b-adde-b39067d1c0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.597576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f14d0-384a-452b-adde-b39067d1c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.597854 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f14d0-384a-452b-adde-b39067d1c0b8 admin admin] PATH_INFO: `/v3/projects/b12fb872442849e1a642372169d02674/users/b1f898dc1aa94f429b5cbf40d14e556a/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.612557 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f14d0-384a-452b-adde-b39067d1c0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12fb872442849e1a642372169d02674, user_id=b1f898dc1aa94f429b5cbf40d14e556a, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.615260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f14d0-384a-452b-adde-b39067d1c0b8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.629255 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1363/2729] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:19 2022] PUT /identity/v3/projects/b12fb872442849e1a642372169d02674/users/b1f898dc1aa94f429b5cbf40d14e556a/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:47:19.633424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e601496-029d-4ff4-94e1-d606cbe5305e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.644679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e601496-029d-4ff4-94e1-d606cbe5305e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.650265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:19.707312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b2147-3665-4307-82c2-40329136ebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.707927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b2147-3665-4307-82c2-40329136ebe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.708207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b2147-3665-4307-82c2-40329136ebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.708480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b2147-3665-4307-82c2-40329136ebe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.709168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b2147-3665-4307-82c2-40329136ebe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.710938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b2147-3665-4307-82c2-40329136ebe9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.722527 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1367/2730] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:19.726779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f14d0-384a-452b-adde-b39067d1c0b8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.737283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f14d0-384a-452b-adde-b39067d1c0b8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.741932 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e176d8-a406-4b3b-be1b-82130e4c590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.742613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e176d8-a406-4b3b-be1b-82130e4c590f admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.742870 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e176d8-a406-4b3b-be1b-82130e4c590f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.743176 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e176d8-a406-4b3b-be1b-82130e4c590f admin admin] PATH_INFO: `/v3/projects/b12fb872442849e1a642372169d02674/users/b1f898dc1aa94f429b5cbf40d14e556a/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.745120 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e176d8-a406-4b3b-be1b-82130e4c590f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12fb872442849e1a642372169d02674, user_id=b1f898dc1aa94f429b5cbf40d14e556a, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.747788 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e176d8-a406-4b3b-be1b-82130e4c590f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.758525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1364/2731] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:19 2022] PUT /identity/v3/projects/b12fb872442849e1a642372169d02674/users/b1f898dc1aa94f429b5cbf40d14e556a/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:19.770187 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b943cb-a56d-4b3d-a78e-8d902c20bda2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.770407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b943cb-a56d-4b3d-a78e-8d902c20bda2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.770686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b943cb-a56d-4b3d-a78e-8d902c20bda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.800622 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-78b943cb-a56d-4b3d-a78e-8d902c20bda2 None None] MFA Rules not processed for user `b1f898dc1aa94f429b5cbf40d14e556a`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:19.801863 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-78b943cb-a56d-4b3d-a78e-8d902c20bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:19.872786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1368/2732] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:19.883287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e176d8-a406-4b3b-be1b-82130e4c590f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:19.885114 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-f8e176d8-a406-4b3b-be1b-82130e4c590f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:19.945424 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e176d8-a406-4b3b-be1b-82130e4c590f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:19.949085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726eca9-0fb2-4b1c-b75a-9c2dcd11814f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:19.949697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726eca9-0fb2-4b1c-b75a-9c2dcd11814f service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:19.949970 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726eca9-0fb2-4b1c-b75a-9c2dcd11814f service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:19.950247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726eca9-0fb2-4b1c-b75a-9c2dcd11814f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:19.959760 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726eca9-0fb2-4b1c-b75a-9c2dcd11814f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:19.961178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726eca9-0fb2-4b1c-b75a-9c2dcd11814f service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:19.970491 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1365/2733] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:20.072014 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b943cb-a56d-4b3d-a78e-8d902c20bda2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:20.082189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b943cb-a56d-4b3d-a78e-8d902c20bda2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:20.085928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e31a6b-4d15-4e47-8b42-96ed68fbf97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:20.086551 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e31a6b-4d15-4e47-8b42-96ed68fbf97b service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:20.086826 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e31a6b-4d15-4e47-8b42-96ed68fbf97b service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:20.087138 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e31a6b-4d15-4e47-8b42-96ed68fbf97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:20.142443 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e31a6b-4d15-4e47-8b42-96ed68fbf97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:20.143895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e31a6b-4d15-4e47-8b42-96ed68fbf97b service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:20.152641 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1369/2734] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:22.762509 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726eca9-0fb2-4b1c-b75a-9c2dcd11814f service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:22.797532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:22.828610 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726eca9-0fb2-4b1c-b75a-9c2dcd11814f service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:22.833067 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:22.833698 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:22.833972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:22.834243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] PATH_INFO: `/v3/users/6b00b672ec64430c87800d2ee692ebb9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:22.835422 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b00b672ec64430c87800d2ee692ebb9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:22.837334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:22.885737 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b00b672ec64430c87800d2ee692ebb9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:22.886400 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b00b672ec64430c87800d2ee692ebb9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:22.898565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b00b672ec64430c87800d2ee692ebb9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:22.906872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b00b672ec64430c87800d2ee692ebb9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:22.911652 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b00b672ec64430c87800d2ee692ebb9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:22.925077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1366/2735] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:22 2022] DELETE /identity/v3/users/6b00b672ec64430c87800d2ee692ebb9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:22.929487 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6015419-8f30-4e3b-a5d5-af0b74fda566 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:22.929966 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6015419-8f30-4e3b-a5d5-af0b74fda566 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:22.930079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6015419-8f30-4e3b-a5d5-af0b74fda566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:22.949906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-d6015419-8f30-4e3b-a5d5-af0b74fda566 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:22.951186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d6015419-8f30-4e3b-a5d5-af0b74fda566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:22.975381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=100 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:23.011153 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1370/2736] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:23.021791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:23.023361 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:23.083618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499fcdf-7cc2-4481-a414-0b0a952ef479 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:23.087235 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5266484-a57a-4710-bbc3-cb00cd87afca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:23.087852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5266484-a57a-4710-bbc3-cb00cd87afca service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:23.088129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5266484-a57a-4710-bbc3-cb00cd87afca service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:23.088393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5266484-a57a-4710-bbc3-cb00cd87afca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:23.098031 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5266484-a57a-4710-bbc3-cb00cd87afca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:23.099560 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5266484-a57a-4710-bbc3-cb00cd87afca service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:23.109918 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1367/2737] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:23.387825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6015419-8f30-4e3b-a5d5-af0b74fda566 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:23.389935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-d6015419-8f30-4e3b-a5d5-af0b74fda566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:23.420202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6015419-8f30-4e3b-a5d5-af0b74fda566 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:23.425085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:23.425771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:23.426050 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:23.426321 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] PATH_INFO: `/v3/projects/b0b0356b3ea647e3b189f3ffab1a0391` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:23.427680 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b0356b3ea647e3b189f3ffab1a0391)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:23.429808 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:23.479322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b0356b3ea647e3b189f3ffab1a0391', 'request_id': 'req-00daec27-5ab3-4fd7-80e4-0610f3ffd144'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.485801 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b0356b3ea647e3b189f3ffab1a0391', 'request_id': 'req-00daec27-5ab3-4fd7-80e4-0610f3ffd144'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.495248 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b0356b3ea647e3b189f3ffab1a0391', 'request_id': 'req-00daec27-5ab3-4fd7-80e4-0610f3ffd144'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.507083 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] The token cache is being invalidate because project b0b0356b3ea647e3b189f3ffab1a0391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:23.507371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.508031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.509548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1371/2738] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:23 2022] DELETE /identity/v3/projects/b0b0356b3ea647e3b189f3ffab1a0391 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:23.513660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5266484-a57a-4710-bbc3-cb00cd87afca service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:23.525119 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5266484-a57a-4710-bbc3-cb00cd87afca service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:23.575401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:23.588233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:23.589085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:23.589516 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:23.590028 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] PATH_INFO: `/v3/users/b1f898dc1aa94f429b5cbf40d14e556a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:23.591303 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f898dc1aa94f429b5cbf40d14e556a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:23.593370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:23.642816 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f898dc1aa94f429b5cbf40d14e556a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.643852 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f898dc1aa94f429b5cbf40d14e556a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.658703 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f898dc1aa94f429b5cbf40d14e556a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.667309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f898dc1aa94f429b5cbf40d14e556a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.667845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5129efbb-81d6-4c55-ac11-3508dc6f50ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f898dc1aa94f429b5cbf40d14e556a'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:23.680752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1368/2739] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:23 2022] DELETE /identity/v3/users/b1f898dc1aa94f429b5cbf40d14e556a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:23.965495 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:23.967144 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:23.981757 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daec27-5ab3-4fd7-80e4-0610f3ffd144 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:24.044454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:24.045202 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.045485 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.045760 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] PATH_INFO: `/v3/projects/b12fb872442849e1a642372169d02674` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.047004 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12fb872442849e1a642372169d02674)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:24.048985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:24.104362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12fb872442849e1a642372169d02674', 'request_id': 'req-9bea0987-4761-48d3-8faa-7dfc46ac4c52'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:24.108552 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:24.112946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12fb872442849e1a642372169d02674', 'request_id': 'req-9bea0987-4761-48d3-8faa-7dfc46ac4c52'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:24.126573 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12fb872442849e1a642372169d02674', 'request_id': 'req-9bea0987-4761-48d3-8faa-7dfc46ac4c52'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:24.139205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] The token cache is being invalidate because project b12fb872442849e1a642372169d02674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:24.139500 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:24.140164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-9bea0987-4761-48d3-8faa-7dfc46ac4c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:24.141940 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1372/2740] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:23 2022] DELETE /identity/v3/projects/b12fb872442849e1a642372169d02674 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:24.147162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3405ce-5f2e-4a9d-8f64-f253a8e83e8f None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.147659 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3405ce-5f2e-4a9d-8f64-f253a8e83e8f None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.147880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3405ce-5f2e-4a9d-8f64-f253a8e83e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.179551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cf3405ce-5f2e-4a9d-8f64-f253a8e83e8f None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:24.181058 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cf3405ce-5f2e-4a9d-8f64-f253a8e83e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:24.261403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185df200-f866-4715-a4a6-c4857c2f396a None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.261719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185df200-f866-4715-a4a6-c4857c2f396a None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.262263 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185df200-f866-4715-a4a6-c4857c2f396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.265475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1369/2741] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:47:24.286691 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-185df200-f866-4715-a4a6-c4857c2f396a None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:24.288110 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-185df200-f866-4715-a4a6-c4857c2f396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:24.297905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1373/2742] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:24.302640 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3405ce-5f2e-4a9d-8f64-f253a8e83e8f None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:24.314515 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3405ce-5f2e-4a9d-8f64-f253a8e83e8f None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:24.321911 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbdb64-dd42-4e48-990e-bd02056d750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:24.322561 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbdb64-dd42-4e48-990e-bd02056d750d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.322837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbdb64-dd42-4e48-990e-bd02056d750d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.323161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbdb64-dd42-4e48-990e-bd02056d750d admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.323874 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbdb64-dd42-4e48-990e-bd02056d750d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:47:24.324179 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbdb64-dd42-4e48-990e-bd02056d750d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:24.325905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbdb64-dd42-4e48-990e-bd02056d750d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:24.340118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1370/2743] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:47:24.345166 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185df200-f866-4715-a4a6-c4857c2f396a None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:24.356895 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185df200-f866-4715-a4a6-c4857c2f396a None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:24.362509 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588036e9-36b0-4b79-a98b-60065c07f854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:24.363502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588036e9-36b0-4b79-a98b-60065c07f854 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.364009 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588036e9-36b0-4b79-a98b-60065c07f854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.364381 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588036e9-36b0-4b79-a98b-60065c07f854 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.365180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588036e9-36b0-4b79-a98b-60065c07f854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:24.367214 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588036e9-36b0-4b79-a98b-60065c07f854 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:24.402479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1374/2744] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:24 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:24.404529 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbdb64-dd42-4e48-990e-bd02056d750d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:24.420021 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbdb64-dd42-4e48-990e-bd02056d750d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:24.491618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102b983-223e-40cf-9e79-89cc24f9f835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:24.491907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102b983-223e-40cf-9e79-89cc24f9f835 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.492228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102b983-223e-40cf-9e79-89cc24f9f835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.492598 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102b983-223e-40cf-9e79-89cc24f9f835 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.493688 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102b983-223e-40cf-9e79-89cc24f9f835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:24.496275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102b983-223e-40cf-9e79-89cc24f9f835 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:24.508559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:24.531386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1371/2745] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:24 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:24.532764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588036e9-36b0-4b79-a98b-60065c07f854 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:24.549508 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588036e9-36b0-4b79-a98b-60065c07f854 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:24.556015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a7777-2fb2-4305-85ec-c56db3bdc612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:24.556658 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a7777-2fb2-4305-85ec-c56db3bdc612 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.556935 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a7777-2fb2-4305-85ec-c56db3bdc612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.557206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a7777-2fb2-4305-85ec-c56db3bdc612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.558233 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a7777-2fb2-4305-85ec-c56db3bdc612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:24.559582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a7777-2fb2-4305-85ec-c56db3bdc612 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:24.574619 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1375/2746] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:47:24.576905 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102b983-223e-40cf-9e79-89cc24f9f835 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:24.588771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102b983-223e-40cf-9e79-89cc24f9f835 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:24.593973 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e71230-ed7d-4619-8821-1df9d807e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:24.594739 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e71230-ed7d-4619-8821-1df9d807e9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.595159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e71230-ed7d-4619-8821-1df9d807e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.595666 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e71230-ed7d-4619-8821-1df9d807e9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.596467 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e71230-ed7d-4619-8821-1df9d807e9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:24.598197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e71230-ed7d-4619-8821-1df9d807e9f3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:24.614795 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1372/2747] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:24.616342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a7777-2fb2-4305-85ec-c56db3bdc612 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:24.627759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a7777-2fb2-4305-85ec-c56db3bdc612 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:24.633374 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a34c07-d3ca-4565-b508-26925bc6f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:24.634193 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a34c07-d3ca-4565-b508-26925bc6f4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.634571 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a34c07-d3ca-4565-b508-26925bc6f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.634942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a34c07-d3ca-4565-b508-26925bc6f4bd admin admin] PATH_INFO: `/v3/projects/600bc5154a8d43b8a8a4a658a027c088/users/7e28f4a4155643319ab36b25f29827ab/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.654721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a34c07-d3ca-4565-b508-26925bc6f4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=600bc5154a8d43b8a8a4a658a027c088, user_id=7e28f4a4155643319ab36b25f29827ab, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:24.658351 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a34c07-d3ca-4565-b508-26925bc6f4bd admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:24.685220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1376/2748] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:24 2022] PUT /identity/v3/projects/600bc5154a8d43b8a8a4a658a027c088/users/7e28f4a4155643319ab36b25f29827ab/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:24.690165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d7ac-6039-4ad8-a6d7-28dcf87765cf None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:24.690165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d7ac-6039-4ad8-a6d7-28dcf87765cf None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:24.690165 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14d7ac-6039-4ad8-a6d7-28dcf87765cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:24.725962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bc14d7ac-6039-4ad8-a6d7-28dcf87765cf None None] MFA Rules not processed for user `7e28f4a4155643319ab36b25f29827ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:24.727513 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bc14d7ac-6039-4ad8-a6d7-28dcf87765cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:24.879643 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1373/2749] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:24.884799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a34c07-d3ca-4565-b508-26925bc6f4bd admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:24.988955 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a34c07-d3ca-4565-b508-26925bc6f4bd admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:24.999452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37160d1a-b46a-44dd-adc8-0e32e07a45a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:25.000766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160d1a-b46a-44dd-adc8-0e32e07a45a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:25.001112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160d1a-b46a-44dd-adc8-0e32e07a45a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:25.001745 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37160d1a-b46a-44dd-adc8-0e32e07a45a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:25.002486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37160d1a-b46a-44dd-adc8-0e32e07a45a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:25.004615 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37160d1a-b46a-44dd-adc8-0e32e07a45a9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:25.043413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1377/2750] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:24 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:25.046143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14d7ac-6039-4ad8-a6d7-28dcf87765cf None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:25.058708 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14d7ac-6039-4ad8-a6d7-28dcf87765cf None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:25.133551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd23a3-eacc-4f2a-9bed-bb4a7308c25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:25.134366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd23a3-eacc-4f2a-9bed-bb4a7308c25d admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:25.134665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd23a3-eacc-4f2a-9bed-bb4a7308c25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:25.135097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd23a3-eacc-4f2a-9bed-bb4a7308c25d admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:25.135789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd23a3-eacc-4f2a-9bed-bb4a7308c25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:25.137779 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd23a3-eacc-4f2a-9bed-bb4a7308c25d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:25.167702 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1374/2751] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:25 2022] POST /identity/v3/users => generated 301 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:25.169466 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37160d1a-b46a-44dd-adc8-0e32e07a45a9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:25.200188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37160d1a-b46a-44dd-adc8-0e32e07a45a9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:25.205550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd852635-dd14-48f2-a4e8-367024583a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:25.206194 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd852635-dd14-48f2-a4e8-367024583a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:25.206469 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd852635-dd14-48f2-a4e8-367024583a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:25.206923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd852635-dd14-48f2-a4e8-367024583a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:25.207987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd852635-dd14-48f2-a4e8-367024583a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:25.210234 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd852635-dd14-48f2-a4e8-367024583a9f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:25.231026 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1378/2752] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:47:25.235658 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd23a3-eacc-4f2a-9bed-bb4a7308c25d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:25.246439 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd23a3-eacc-4f2a-9bed-bb4a7308c25d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:25.252132 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba95e35-2e2f-4e67-b9ee-bac6bf9743ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:25.252823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba95e35-2e2f-4e67-b9ee-bac6bf9743ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:25.253101 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba95e35-2e2f-4e67-b9ee-bac6bf9743ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:25.253377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba95e35-2e2f-4e67-b9ee-bac6bf9743ad admin admin] PATH_INFO: `/v3/projects/80adf3ab56f4427abcc6e192f7599cfe/users/69c9e0c6d76849b9adb3371ee4dace16/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:25.272047 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba95e35-2e2f-4e67-b9ee-bac6bf9743ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=80adf3ab56f4427abcc6e192f7599cfe, user_id=69c9e0c6d76849b9adb3371ee4dace16, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:25.275266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba95e35-2e2f-4e67-b9ee-bac6bf9743ad admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:25.298858 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1375/2753] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:25 2022] PUT /identity/v3/projects/80adf3ab56f4427abcc6e192f7599cfe/users/69c9e0c6d76849b9adb3371ee4dace16/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:47:25.302700 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd852635-dd14-48f2-a4e8-367024583a9f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:25.313720 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd852635-dd14-48f2-a4e8-367024583a9f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:25.369736 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:25.382891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e231cf-9b70-4444-aecc-3285af5b324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:25.384304 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e231cf-9b70-4444-aecc-3285af5b324d admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:25.385493 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e231cf-9b70-4444-aecc-3285af5b324d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:25.385815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e231cf-9b70-4444-aecc-3285af5b324d admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:25.386705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e231cf-9b70-4444-aecc-3285af5b324d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:25.388454 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e231cf-9b70-4444-aecc-3285af5b324d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:25.401335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1379/2754] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:25.405224 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba95e35-2e2f-4e67-b9ee-bac6bf9743ad admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:25.415846 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba95e35-2e2f-4e67-b9ee-bac6bf9743ad admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:25.421997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003ee1b-3102-4520-9c6b-8d894742931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:25.422245 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003ee1b-3102-4520-9c6b-8d894742931c admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:25.423225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003ee1b-3102-4520-9c6b-8d894742931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:25.423503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003ee1b-3102-4520-9c6b-8d894742931c admin admin] PATH_INFO: `/v3/projects/80adf3ab56f4427abcc6e192f7599cfe/users/69c9e0c6d76849b9adb3371ee4dace16/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:25.425613 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003ee1b-3102-4520-9c6b-8d894742931c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80adf3ab56f4427abcc6e192f7599cfe, user_id=69c9e0c6d76849b9adb3371ee4dace16, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:25.428281 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003ee1b-3102-4520-9c6b-8d894742931c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:25.441535 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1376/2755] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:25 2022] PUT /identity/v3/projects/80adf3ab56f4427abcc6e192f7599cfe/users/69c9e0c6d76849b9adb3371ee4dace16/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:25.453399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08487c-9986-472e-a2e1-b678c26e14f4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:25.453693 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08487c-9986-472e-a2e1-b678c26e14f4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:25.454296 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08487c-9986-472e-a2e1-b678c26e14f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:25.489197 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-6d08487c-9986-472e-a2e1-b678c26e14f4 None None] MFA Rules not processed for user `69c9e0c6d76849b9adb3371ee4dace16`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:25.490578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-6d08487c-9986-472e-a2e1-b678c26e14f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:25.576069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1380/2756] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:25.588042 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003ee1b-3102-4520-9c6b-8d894742931c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:25.590149 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a003ee1b-3102-4520-9c6b-8d894742931c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:25.615934 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:25.660198 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003ee1b-3102-4520-9c6b-8d894742931c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:25.664009 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2adec8-7e98-4437-ba0a-4935582e6952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:25.664641 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2adec8-7e98-4437-ba0a-4935582e6952 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:25.664918 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2adec8-7e98-4437-ba0a-4935582e6952 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:25.665218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2adec8-7e98-4437-ba0a-4935582e6952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:25.675835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2adec8-7e98-4437-ba0a-4935582e6952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:25.677283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2adec8-7e98-4437-ba0a-4935582e6952 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:25.695124 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1377/2757] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:25 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:25.847626 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08487c-9986-472e-a2e1-b678c26e14f4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:25.919686 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08487c-9986-472e-a2e1-b678c26e14f4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:25.925927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:25.926656 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:25.928300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:25.928580 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] PATH_INFO: `/v3/users/7e28f4a4155643319ab36b25f29827ab` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:25.930762 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e28f4a4155643319ab36b25f29827ab)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:25.932923 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:25.988109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e28f4a4155643319ab36b25f29827ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:25.988769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e28f4a4155643319ab36b25f29827ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.003765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e28f4a4155643319ab36b25f29827ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.010599 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e28f4a4155643319ab36b25f29827ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.013603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:26.022657 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e28f4a4155643319ab36b25f29827ab'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.030400 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1381/2758] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:25 2022] DELETE /identity/v3/users/7e28f4a4155643319ab36b25f29827ab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:26.035267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9edfaf-3f3f-49ed-a82f-bac2bf2c9616 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:26.035618 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9edfaf-3f3f-49ed-a82f-bac2bf2c9616 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:26.035961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9edfaf-3f3f-49ed-a82f-bac2bf2c9616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:26.055015 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fb9edfaf-3f3f-49ed-a82f-bac2bf2c9616 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:26.056352 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fb9edfaf-3f3f-49ed-a82f-bac2bf2c9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:26.122876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1378/2759] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:26.134605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:26.137464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:26.205036 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3e6ed-042a-4871-be9e-44c4197c37ad admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:26.208934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a95f9-6cb6-47e6-b112-9609cb29bc79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:26.209562 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a95f9-6cb6-47e6-b112-9609cb29bc79 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:26.209871 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a95f9-6cb6-47e6-b112-9609cb29bc79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:26.210135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a95f9-6cb6-47e6-b112-9609cb29bc79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:26.228450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a95f9-6cb6-47e6-b112-9609cb29bc79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:26.229998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a95f9-6cb6-47e6-b112-9609cb29bc79 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:26.253440 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1382/2760] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:47:26.619738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9edfaf-3f3f-49ed-a82f-bac2bf2c9616 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:26.621767 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fb9edfaf-3f3f-49ed-a82f-bac2bf2c9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:26.644227 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9edfaf-3f3f-49ed-a82f-bac2bf2c9616 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:26.651143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:26.651958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:26.652878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:26.653266 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] PATH_INFO: `/v3/projects/600bc5154a8d43b8a8a4a658a027c088` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:26.654578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=600bc5154a8d43b8a8a4a658a027c088)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:26.656806 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:26.740468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '600bc5154a8d43b8a8a4a658a027c088', 'request_id': 'req-e9ba9005-b452-4ac2-89b8-1389057804d8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.749346 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '600bc5154a8d43b8a8a4a658a027c088', 'request_id': 'req-e9ba9005-b452-4ac2-89b8-1389057804d8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.764039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '600bc5154a8d43b8a8a4a658a027c088', 'request_id': 'req-e9ba9005-b452-4ac2-89b8-1389057804d8'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.781437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] The token cache is being invalidate because project 600bc5154a8d43b8a8a4a658a027c088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:26.782085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.783680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.785707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1379/2761] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:26 2022] DELETE /identity/v3/projects/600bc5154a8d43b8a8a4a658a027c088 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:26.789629 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a95f9-6cb6-47e6-b112-9609cb29bc79 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:26.805919 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a95f9-6cb6-47e6-b112-9609cb29bc79 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:26.900689 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:26.901431 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:26.901727 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:26.902158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] PATH_INFO: `/v3/users/69c9e0c6d76849b9adb3371ee4dace16` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:26.903276 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c9e0c6d76849b9adb3371ee4dace16)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:26.905235 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:26.961403 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c9e0c6d76849b9adb3371ee4dace16'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.962076 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c9e0c6d76849b9adb3371ee4dace16'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.977643 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c9e0c6d76849b9adb3371ee4dace16'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.986942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c9e0c6d76849b9adb3371ee4dace16'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:26.997264 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-646b70d7-1aa1-4823-9035-0902198f03fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c9e0c6d76849b9adb3371ee4dace16'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:27.007077 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1383/2762] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:26 2022] DELETE /identity/v3/users/69c9e0c6d76849b9adb3371ee4dace16 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:27.318565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:27.320712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:27.343969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba9005-b452-4ac2-89b8-1389057804d8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:27.418511 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:27.435671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:27.436759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:27.437675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:27.438185 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] PATH_INFO: `/v3/projects/80adf3ab56f4427abcc6e192f7599cfe` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:27.439931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=80adf3ab56f4427abcc6e192f7599cfe)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:27.442490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:27.499425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80adf3ab56f4427abcc6e192f7599cfe', 'request_id': 'req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:27.508445 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80adf3ab56f4427abcc6e192f7599cfe', 'request_id': 'req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:27.518507 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80adf3ab56f4427abcc6e192f7599cfe', 'request_id': 'req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:27.532393 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] The token cache is being invalidate because project 80adf3ab56f4427abcc6e192f7599cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:27.532671 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:27.534151 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d7c492e9-6e1d-439a-8a61-f1dddb5107cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:27.540027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1380/2763] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:27 2022] DELETE /identity/v3/projects/80adf3ab56f4427abcc6e192f7599cfe => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:27.541535 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1390f0-f4e2-47bd-b6c7-f2c275b98288 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:27.541832 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1390f0-f4e2-47bd-b6c7-f2c275b98288 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:27.542104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1390f0-f4e2-47bd-b6c7-f2c275b98288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:27.569346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-cc1390f0-f4e2-47bd-b6c7-f2c275b98288 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:27.569346 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-cc1390f0-f4e2-47bd-b6c7-f2c275b98288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:27.581020 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:27.653361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1384/2764] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:27.662620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879d95-a1c0-47d5-b63e-dd6606a6f3ef None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:27.663158 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879d95-a1c0-47d5-b63e-dd6606a6f3ef None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:27.663287 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879d95-a1c0-47d5-b63e-dd6606a6f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:27.686007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fd879d95-a1c0-47d5-b63e-dd6606a6f3ef None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:27.687599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fd879d95-a1c0-47d5-b63e-dd6606a6f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:27.697212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1381/2765] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:27.702118 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1390f0-f4e2-47bd-b6c7-f2c275b98288 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:27.712244 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1390f0-f4e2-47bd-b6c7-f2c275b98288 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:27.717209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941b8f0-5389-4bd5-9930-0c4225bdff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:27.718068 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b8f0-5389-4bd5-9930-0c4225bdff3e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:27.718926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b8f0-5389-4bd5-9930-0c4225bdff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:27.719238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941b8f0-5389-4bd5-9930-0c4225bdff3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:27.719970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941b8f0-5389-4bd5-9930-0c4225bdff3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:47:27.720272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941b8f0-5389-4bd5-9930-0c4225bdff3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:27.721946 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941b8f0-5389-4bd5-9930-0c4225bdff3e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:27.738976 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1385/2766] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:47:27.740334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd879d95-a1c0-47d5-b63e-dd6606a6f3ef None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:27.751866 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd879d95-a1c0-47d5-b63e-dd6606a6f3ef None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:27.758258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f930-b040-4de8-b288-1c80072f3340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:27.758935 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f930-b040-4de8-b288-1c80072f3340 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:27.759313 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f930-b040-4de8-b288-1c80072f3340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:27.759586 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f930-b040-4de8-b288-1c80072f3340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:27.760226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f930-b040-4de8-b288-1c80072f3340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:27.762177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f930-b040-4de8-b288-1c80072f3340 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:27.794874 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1382/2767] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:27 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:27.797698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941b8f0-5389-4bd5-9930-0c4225bdff3e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:27.808450 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941b8f0-5389-4bd5-9930-0c4225bdff3e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:27.870483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9119c-ca7f-481f-981f-594f8609cb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:27.871040 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9119c-ca7f-481f-981f-594f8609cb3f admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:27.871323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9119c-ca7f-481f-981f-594f8609cb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:27.871593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9119c-ca7f-481f-981f-594f8609cb3f admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:27.872249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9119c-ca7f-481f-981f-594f8609cb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:27.874171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9119c-ca7f-481f-981f-594f8609cb3f admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:27.899182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1386/2768] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:27 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:27.900396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f930-b040-4de8-b288-1c80072f3340 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:27.911552 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f930-b040-4de8-b288-1c80072f3340 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:27.916111 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c948b-2158-415e-9dd1-e0e95f62bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:27.916743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c948b-2158-415e-9dd1-e0e95f62bf3d admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:27.917024 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c948b-2158-415e-9dd1-e0e95f62bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:27.917296 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c948b-2158-415e-9dd1-e0e95f62bf3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:27.917979 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c948b-2158-415e-9dd1-e0e95f62bf3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:27.919601 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c948b-2158-415e-9dd1-e0e95f62bf3d admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:27.929602 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1383/2769] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:27.933575 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9119c-ca7f-481f-981f-594f8609cb3f admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:27.943480 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9119c-ca7f-481f-981f-594f8609cb3f admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:27.948109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15377c76-d5ea-4ee8-8284-e69be04deae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:27.948707 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15377c76-d5ea-4ee8-8284-e69be04deae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:27.948984 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15377c76-d5ea-4ee8-8284-e69be04deae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:27.949254 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15377c76-d5ea-4ee8-8284-e69be04deae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:27.949938 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15377c76-d5ea-4ee8-8284-e69be04deae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:27.951554 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15377c76-d5ea-4ee8-8284-e69be04deae9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:27.963772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1387/2770] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:27.967928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c948b-2158-415e-9dd1-e0e95f62bf3d admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:27.978692 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c948b-2158-415e-9dd1-e0e95f62bf3d admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:27.983368 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6a5e3-54c9-429d-90cc-8545c3672bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:27.984023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6a5e3-54c9-429d-90cc-8545c3672bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:27.984305 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6a5e3-54c9-429d-90cc-8545c3672bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:27.984579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6a5e3-54c9-429d-90cc-8545c3672bfb admin admin] PATH_INFO: `/v3/projects/e1bbbbac0c114a5896591bdc908dbaf2/users/3fb8a03f4ea7474e991315afeeac9845/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.000014 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6a5e3-54c9-429d-90cc-8545c3672bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bbbbac0c114a5896591bdc908dbaf2, user_id=3fb8a03f4ea7474e991315afeeac9845, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:28.002669 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6a5e3-54c9-429d-90cc-8545c3672bfb admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:28.016168 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1384/2771] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:27 2022] PUT /identity/v3/projects/e1bbbbac0c114a5896591bdc908dbaf2/users/3fb8a03f4ea7474e991315afeeac9845/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:28.027526 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb2701-11c2-45a7-af52-d7d683c89647 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.028017 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb2701-11c2-45a7-af52-d7d683c89647 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.028131 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb2701-11c2-45a7-af52-d7d683c89647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.056162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-b7fb2701-11c2-45a7-af52-d7d683c89647 None None] MFA Rules not processed for user `3fb8a03f4ea7474e991315afeeac9845`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:28.057393 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b7fb2701-11c2-45a7-af52-d7d683c89647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:28.121496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1388/2772] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:28.126318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6a5e3-54c9-429d-90cc-8545c3672bfb admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:28.188485 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6a5e3-54c9-429d-90cc-8545c3672bfb admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:28.193442 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f34732-aa23-42ab-916b-46d46bbe98a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:28.194062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f34732-aa23-42ab-916b-46d46bbe98a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.194336 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f34732-aa23-42ab-916b-46d46bbe98a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.194607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f34732-aa23-42ab-916b-46d46bbe98a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.195405 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f34732-aa23-42ab-916b-46d46bbe98a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:28.197284 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f34732-aa23-42ab-916b-46d46bbe98a2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:28.218251 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:28.229339 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1385/2773] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:28 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:28.230545 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb2701-11c2-45a7-af52-d7d683c89647 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:28.242269 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb2701-11c2-45a7-af52-d7d683c89647 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:28.250761 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:28.300589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccdaa8-a430-47c0-a3c3-18ba012994c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:28.301206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccdaa8-a430-47c0-a3c3-18ba012994c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.301489 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccdaa8-a430-47c0-a3c3-18ba012994c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.301765 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccdaa8-a430-47c0-a3c3-18ba012994c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.302419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccdaa8-a430-47c0-a3c3-18ba012994c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:28.304519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccdaa8-a430-47c0-a3c3-18ba012994c4 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:28.326339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1389/2774] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:28 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:28.330877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f34732-aa23-42ab-916b-46d46bbe98a2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:28.341221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f34732-aa23-42ab-916b-46d46bbe98a2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:28.345877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4ab9-2fd6-4e9f-9a2a-71f3f416cbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:28.346488 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4ab9-2fd6-4e9f-9a2a-71f3f416cbff admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.346763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4ab9-2fd6-4e9f-9a2a-71f3f416cbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.347055 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4ab9-2fd6-4e9f-9a2a-71f3f416cbff admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.347772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d4ab9-2fd6-4e9f-9a2a-71f3f416cbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:28.349343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d4ab9-2fd6-4e9f-9a2a-71f3f416cbff admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:28.360140 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1386/2775] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:28.364525 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccdaa8-a430-47c0-a3c3-18ba012994c4 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:28.376104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccdaa8-a430-47c0-a3c3-18ba012994c4 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:28.381218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00e81e-b7c0-427f-9bf9-e73d7eb914b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:28.381937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e81e-b7c0-427f-9bf9-e73d7eb914b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.382306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e81e-b7c0-427f-9bf9-e73d7eb914b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.382550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00e81e-b7c0-427f-9bf9-e73d7eb914b2 admin admin] PATH_INFO: `/v3/projects/aa9438101144477ba29f4bb5e5ddb2f7/users/0278d417e32c4401b2e1c97648d1fb42/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.399135 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00e81e-b7c0-427f-9bf9-e73d7eb914b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9438101144477ba29f4bb5e5ddb2f7, user_id=0278d417e32c4401b2e1c97648d1fb42, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:28.401839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00e81e-b7c0-427f-9bf9-e73d7eb914b2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:28.421170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1390/2776] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:28 2022] PUT /identity/v3/projects/aa9438101144477ba29f4bb5e5ddb2f7/users/0278d417e32c4401b2e1c97648d1fb42/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:28.428043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4ab9-2fd6-4e9f-9a2a-71f3f416cbff admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:28.438978 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4ab9-2fd6-4e9f-9a2a-71f3f416cbff admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:28.495663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ea50a-2cb8-4df1-abc3-1fadbffb7c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:28.496285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ea50a-2cb8-4df1-abc3-1fadbffb7c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.496567 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ea50a-2cb8-4df1-abc3-1fadbffb7c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.496840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ea50a-2cb8-4df1-abc3-1fadbffb7c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.497536 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ea50a-2cb8-4df1-abc3-1fadbffb7c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:28.499187 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ea50a-2cb8-4df1-abc3-1fadbffb7c24 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:28.515768 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1387/2777] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:28.516934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00e81e-b7c0-427f-9bf9-e73d7eb914b2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:28.527684 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00e81e-b7c0-427f-9bf9-e73d7eb914b2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:28.533350 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35481a3c-c401-49d5-80c6-d1276c8f8fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:28.534130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35481a3c-c401-49d5-80c6-d1276c8f8fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.534539 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35481a3c-c401-49d5-80c6-d1276c8f8fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.534812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35481a3c-c401-49d5-80c6-d1276c8f8fe2 admin admin] PATH_INFO: `/v3/projects/aa9438101144477ba29f4bb5e5ddb2f7/users/0278d417e32c4401b2e1c97648d1fb42/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.536985 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35481a3c-c401-49d5-80c6-d1276c8f8fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9438101144477ba29f4bb5e5ddb2f7, user_id=0278d417e32c4401b2e1c97648d1fb42, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:28.540032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35481a3c-c401-49d5-80c6-d1276c8f8fe2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:28.550959 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1391/2778] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:28 2022] PUT /identity/v3/projects/aa9438101144477ba29f4bb5e5ddb2f7/users/0278d417e32c4401b2e1c97648d1fb42/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:28.561599 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569605e5-32c9-4631-85ca-5efbfaa81874 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.562469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569605e5-32c9-4631-85ca-5efbfaa81874 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.562789 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569605e5-32c9-4631-85ca-5efbfaa81874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.591691 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-569605e5-32c9-4631-85ca-5efbfaa81874 None None] MFA Rules not processed for user `0278d417e32c4401b2e1c97648d1fb42`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:28.592899 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-569605e5-32c9-4631-85ca-5efbfaa81874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:28.663697 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1388/2779] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:28.675593 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35481a3c-c401-49d5-80c6-d1276c8f8fe2 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:28.677314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-35481a3c-c401-49d5-80c6-d1276c8f8fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:28.739851 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35481a3c-c401-49d5-80c6-d1276c8f8fe2 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:28.743589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc11d5-1376-426b-a829-2ae144179f64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:28.744218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc11d5-1376-426b-a829-2ae144179f64 service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.744499 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc11d5-1376-426b-a829-2ae144179f64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.744770 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc11d5-1376-426b-a829-2ae144179f64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.755794 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc11d5-1376-426b-a829-2ae144179f64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:28.757354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc11d5-1376-426b-a829-2ae144179f64 service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:28.768417 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1392/2780] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:28.869240 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569605e5-32c9-4631-85ca-5efbfaa81874 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:28.879104 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569605e5-32c9-4631-85ca-5efbfaa81874 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:28.883094 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154bb27-951e-49a6-a4b4-983a0a46e529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:28.883656 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154bb27-951e-49a6-a4b4-983a0a46e529 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:28.883959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154bb27-951e-49a6-a4b4-983a0a46e529 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:28.884232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154bb27-951e-49a6-a4b4-983a0a46e529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:28.951390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154bb27-951e-49a6-a4b4-983a0a46e529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:28.953441 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154bb27-951e-49a6-a4b4-983a0a46e529 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:28.963180 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1389/2781] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:32.385112 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee804-1abb-434a-9335-9eab7330c247 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:32.385642 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee804-1abb-434a-9335-9eab7330c247 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:32.385806 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee804-1abb-434a-9335-9eab7330c247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:32.408376 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-756ee804-1abb-434a-9335-9eab7330c247 None None] MFA Rules not processed for user `fb129070880846549efcb9925c2736c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:32.409803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-756ee804-1abb-434a-9335-9eab7330c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:32.479790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1393/2782] 10.222.0.57 () {58 vars in 967 bytes} [Thu Aug 4 04:47:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:32.533434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154bb27-951e-49a6-a4b4-983a0a46e529 service cinder] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:32.533434 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5154bb27-951e-49a6-a4b4-983a0a46e529 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:32.545010 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=100 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:32.621651 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154bb27-951e-49a6-a4b4-983a0a46e529 service cinder] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:32.628958 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cf6db-8351-4f77-85f2-7bb30eb2bbc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dcb9d2fbde74819b3848d050299cfe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:32.629588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf6db-8351-4f77-85f2-7bb30eb2bbc0 service swift] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:32.629868 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf6db-8351-4f77-85f2-7bb30eb2bbc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:32.630141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf6db-8351-4f77-85f2-7bb30eb2bbc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:32.644879 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cf6db-8351-4f77-85f2-7bb30eb2bbc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:32.646506 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cf6db-8351-4f77-85f2-7bb30eb2bbc0 service swift] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:32.655075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1390/2783] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Aug 4 04:47:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 04:47:33.822502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee804-1abb-434a-9335-9eab7330c247 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:33.836322 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:33.898600 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee804-1abb-434a-9335-9eab7330c247 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:33.903587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:33.904385 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:33.904685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:33.905229 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] PATH_INFO: `/v3/users/3fb8a03f4ea7474e991315afeeac9845` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:33.906354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb8a03f4ea7474e991315afeeac9845)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:33.908906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:33.972464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb8a03f4ea7474e991315afeeac9845'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:33.973459 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb8a03f4ea7474e991315afeeac9845'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:33.991323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb8a03f4ea7474e991315afeeac9845'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.001737 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb8a03f4ea7474e991315afeeac9845'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.016505 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb8a03f4ea7474e991315afeeac9845'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.023901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1394/2784] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:33 2022] DELETE /identity/v3/users/3fb8a03f4ea7474e991315afeeac9845 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:34.028576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647cc2-41d8-46c5-993c-cd75057dc231 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:34.029065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647cc2-41d8-46c5-993c-cd75057dc231 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:34.029304 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647cc2-41d8-46c5-993c-cd75057dc231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:34.053408 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-74647cc2-41d8-46c5-993c-cd75057dc231 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:34.054742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-74647cc2-41d8-46c5-993c-cd75057dc231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:34.155897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1391/2785] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:47:34.166206 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:34.167701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:34.229482 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f93d-9da6-43db-8e74-46762c05e3c8 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:34.233001 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9de1-efa5-4c9f-abab-7f367e0dedb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:34.234211 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9de1-efa5-4c9f-abab-7f367e0dedb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:34.234517 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9de1-efa5-4c9f-abab-7f367e0dedb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:34.234795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9de1-efa5-4c9f-abab-7f367e0dedb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:34.244704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9de1-efa5-4c9f-abab-7f367e0dedb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:34.246162 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9de1-efa5-4c9f-abab-7f367e0dedb3 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:34.256880 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1395/2786] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 04:47:34.569223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647cc2-41d8-46c5-993c-cd75057dc231 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:34.571980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-74647cc2-41d8-46c5-993c-cd75057dc231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:34.595929 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647cc2-41d8-46c5-993c-cd75057dc231 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:34.601577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:34.602653 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:34.603142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:34.603573 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] PATH_INFO: `/v3/projects/e1bbbbac0c114a5896591bdc908dbaf2` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:34.605043 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bbbbac0c114a5896591bdc908dbaf2)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:34.608065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:34.692910 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bbbbac0c114a5896591bdc908dbaf2', 'request_id': 'req-6617558c-35ce-4e6b-a807-924cdd068a05'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.700885 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bbbbac0c114a5896591bdc908dbaf2', 'request_id': 'req-6617558c-35ce-4e6b-a807-924cdd068a05'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.711457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bbbbac0c114a5896591bdc908dbaf2', 'request_id': 'req-6617558c-35ce-4e6b-a807-924cdd068a05'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.728175 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] The token cache is being invalidate because project e1bbbbac0c114a5896591bdc908dbaf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:34.728468 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.729877 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.737167 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1392/2787] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:34 2022] DELETE /identity/v3/projects/e1bbbbac0c114a5896591bdc908dbaf2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:34.742683 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9de1-efa5-4c9f-abab-7f367e0dedb3 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:34.756766 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9de1-efa5-4c9f-abab-7f367e0dedb3 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:34.798333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:34.841062 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:34.841772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:34.841988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:34.842265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] PATH_INFO: `/v3/users/0278d417e32c4401b2e1c97648d1fb42` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:34.844104 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0278d417e32c4401b2e1c97648d1fb42)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:34.846113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:34.903428 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0278d417e32c4401b2e1c97648d1fb42'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.904085 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0278d417e32c4401b2e1c97648d1fb42'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.925735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0278d417e32c4401b2e1c97648d1fb42'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.936371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0278d417e32c4401b2e1c97648d1fb42'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.946596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-880a32c0-8e54-4dfb-9e2d-50f7957b7b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0278d417e32c4401b2e1c97648d1fb42'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:34.956451 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1396/2788] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:34 2022] DELETE /identity/v3/users/0278d417e32c4401b2e1c97648d1fb42 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:35.291961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:35.293457 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:35.313997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617558c-35ce-4e6b-a807-924cdd068a05 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:35.341609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:35.395803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:35.396371 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:35.396648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:35.396919 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] PATH_INFO: `/v3/projects/aa9438101144477ba29f4bb5e5ddb2f7` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:35.398121 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9438101144477ba29f4bb5e5ddb2f7)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:35.400113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:35.462876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9438101144477ba29f4bb5e5ddb2f7', 'request_id': 'req-440ae59a-c51f-4c32-bf85-8c2d29077782'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:35.471069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9438101144477ba29f4bb5e5ddb2f7', 'request_id': 'req-440ae59a-c51f-4c32-bf85-8c2d29077782'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:35.486302 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9438101144477ba29f4bb5e5ddb2f7', 'request_id': 'req-440ae59a-c51f-4c32-bf85-8c2d29077782'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:35.502862 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] The token cache is being invalidate because project aa9438101144477ba29f4bb5e5ddb2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:35.503558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:35.504456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-440ae59a-c51f-4c32-bf85-8c2d29077782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:35.506455 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1393/2789] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:35 2022] DELETE /identity/v3/projects/aa9438101144477ba29f4bb5e5ddb2f7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:35.514127 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ac7d5-f195-468b-bd79-0aed83f25211 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:35.514815 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ac7d5-f195-468b-bd79-0aed83f25211 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:35.515340 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ac7d5-f195-468b-bd79-0aed83f25211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:35.547764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-e73ac7d5-f195-468b-bd79-0aed83f25211 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:35.549210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e73ac7d5-f195-468b-bd79-0aed83f25211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:35.638421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1397/2790] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:35.646778 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d8de-6e33-4a6d-b9c4-3111433300f6 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:35.647098 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d8de-6e33-4a6d-b9c4-3111433300f6 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:35.647372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d8de-6e33-4a6d-b9c4-3111433300f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:35.668432 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-4467d8de-6e33-4a6d-b9c4-3111433300f6 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:35.669655 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4467d8de-6e33-4a6d-b9c4-3111433300f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:35.678437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1394/2791] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:35.683314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ac7d5-f195-468b-bd79-0aed83f25211 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:35.694647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ac7d5-f195-468b-bd79-0aed83f25211 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:35.699734 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358ab84-4ed9-4690-a6f0-ecfd6dd9c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:35.700460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ab84-4ed9-4690-a6f0-ecfd6dd9c0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:35.700814 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ab84-4ed9-4690-a6f0-ecfd6dd9c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:35.701152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ab84-4ed9-4690-a6f0-ecfd6dd9c0f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:35.701994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358ab84-4ed9-4690-a6f0-ecfd6dd9c0f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:47:35.702434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358ab84-4ed9-4690-a6f0-ecfd6dd9c0f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:35.704360 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358ab84-4ed9-4690-a6f0-ecfd6dd9c0f1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:35.720829 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1398/2792] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:47:35.725177 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467d8de-6e33-4a6d-b9c4-3111433300f6 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:35.741241 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467d8de-6e33-4a6d-b9c4-3111433300f6 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:35.746310 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5bc70-2418-4aae-be7c-8dcff8c752a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:35.747738 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5bc70-2418-4aae-be7c-8dcff8c752a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:35.747999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5bc70-2418-4aae-be7c-8dcff8c752a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:35.748272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5bc70-2418-4aae-be7c-8dcff8c752a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:35.748999 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5bc70-2418-4aae-be7c-8dcff8c752a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:35.750933 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5bc70-2418-4aae-be7c-8dcff8c752a7 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:35.793743 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1395/2793] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:47:35 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:47:35.798266 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358ab84-4ed9-4690-a6f0-ecfd6dd9c0f1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:35.809705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358ab84-4ed9-4690-a6f0-ecfd6dd9c0f1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:35.860799 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:35.881620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49577b-e12e-45d3-8b07-be6a79d04700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:35.882156 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49577b-e12e-45d3-8b07-be6a79d04700 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:35.882439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49577b-e12e-45d3-8b07-be6a79d04700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:35.882710 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49577b-e12e-45d3-8b07-be6a79d04700 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:35.883418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49577b-e12e-45d3-8b07-be6a79d04700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:35.885949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49577b-e12e-45d3-8b07-be6a79d04700 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:35.910904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1399/2794] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:47:35 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:47:35.915154 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5bc70-2418-4aae-be7c-8dcff8c752a7 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:35.927993 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5bc70-2418-4aae-be7c-8dcff8c752a7 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:35.933426 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f831b6a-fb13-4c75-a78f-e3a46c6f76ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:35.934211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f831b6a-fb13-4c75-a78f-e3a46c6f76ba admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:35.935108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f831b6a-fb13-4c75-a78f-e3a46c6f76ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:35.935108 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f831b6a-fb13-4c75-a78f-e3a46c6f76ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:35.935766 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f831b6a-fb13-4c75-a78f-e3a46c6f76ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:35.937880 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f831b6a-fb13-4c75-a78f-e3a46c6f76ba admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:35.948923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1396/2795] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:47:35.954270 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49577b-e12e-45d3-8b07-be6a79d04700 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:35.966330 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49577b-e12e-45d3-8b07-be6a79d04700 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:35.984464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd3e6-3b51-4e01-9ffb-97fb140d305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:35.985791 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd3e6-3b51-4e01-9ffb-97fb140d305e admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:35.986448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd3e6-3b51-4e01-9ffb-97fb140d305e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:35.987120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd3e6-3b51-4e01-9ffb-97fb140d305e admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:35.997603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd3e6-3b51-4e01-9ffb-97fb140d305e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:35.999514 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd3e6-3b51-4e01-9ffb-97fb140d305e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:36.011904 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1400/2796] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:47:36.016160 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f831b6a-fb13-4c75-a78f-e3a46c6f76ba admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:36.027878 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f831b6a-fb13-4c75-a78f-e3a46c6f76ba admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:36.034390 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a85256-0bdf-4e2c-8862-ed658688f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:36.035265 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a85256-0bdf-4e2c-8862-ed658688f593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:36.035835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a85256-0bdf-4e2c-8862-ed658688f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:36.036061 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a85256-0bdf-4e2c-8862-ed658688f593 admin admin] PATH_INFO: `/v3/projects/a4b7d3b816e542588105fd541e9895bc/users/ebec16d5d3e2450b9c655b5f5a378f76/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:36.057876 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a85256-0bdf-4e2c-8862-ed658688f593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b7d3b816e542588105fd541e9895bc, user_id=ebec16d5d3e2450b9c655b5f5a378f76, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:36.059221 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a85256-0bdf-4e2c-8862-ed658688f593 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:36.075956 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1397/2797] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:47:36 2022] PUT /identity/v3/projects/a4b7d3b816e542588105fd541e9895bc/users/ebec16d5d3e2450b9c655b5f5a378f76/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:47:36.156031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836eee2-8a41-4c12-a707-eb9bd7fb5465 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:36.156327 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836eee2-8a41-4c12-a707-eb9bd7fb5465 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:36.156605 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836eee2-8a41-4c12-a707-eb9bd7fb5465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:36.192185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2836eee2-8a41-4c12-a707-eb9bd7fb5465 None None] MFA Rules not processed for user `ebec16d5d3e2450b9c655b5f5a378f76`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:36.192918 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2836eee2-8a41-4c12-a707-eb9bd7fb5465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:36.321008 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1401/2798] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:36.333298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a85256-0bdf-4e2c-8862-ed658688f593 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:36.335460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-10a85256-0bdf-4e2c-8862-ed658688f593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:36.413665 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:36.422855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a85256-0bdf-4e2c-8862-ed658688f593 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:36.428849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6effd1-81ef-401b-a9bd-91eebbb28ea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:36.429684 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6effd1-81ef-401b-a9bd-91eebbb28ea9 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:36.430167 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6effd1-81ef-401b-a9bd-91eebbb28ea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:36.430438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6effd1-81ef-401b-a9bd-91eebbb28ea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:36.440113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6effd1-81ef-401b-a9bd-91eebbb28ea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:36.441925 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6effd1-81ef-401b-a9bd-91eebbb28ea9 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:36.459017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1398/2799] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:36.490147 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836eee2-8a41-4c12-a707-eb9bd7fb5465 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:36.578172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836eee2-8a41-4c12-a707-eb9bd7fb5465 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:36.583568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:36.584165 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:36.584444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:36.584870 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] PATH_INFO: `/v3/users/ebec16d5d3e2450b9c655b5f5a378f76` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:36.586071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebec16d5d3e2450b9c655b5f5a378f76)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:36.588581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:36.646182 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebec16d5d3e2450b9c655b5f5a378f76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:36.648289 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebec16d5d3e2450b9c655b5f5a378f76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:36.650326 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:36.665812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebec16d5d3e2450b9c655b5f5a378f76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:36.676502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebec16d5d3e2450b9c655b5f5a378f76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:36.685494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebec16d5d3e2450b9c655b5f5a378f76'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:36.692195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1402/2800] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:36 2022] DELETE /identity/v3/users/ebec16d5d3e2450b9c655b5f5a378f76 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:36.697419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e676d-d324-4bcc-863a-3409fc802ca1 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:36.697853 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e676d-d324-4bcc-863a-3409fc802ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:36.698127 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e676d-d324-4bcc-863a-3409fc802ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:36.721159 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-ff9e676d-d324-4bcc-863a-3409fc802ca1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:47:36.722490 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ff9e676d-d324-4bcc-863a-3409fc802ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:36.790901 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1399/2801] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:47:36.801232 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:36.802764 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:36.865200 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80603-0a37-42b2-9805-bf26cfbcb42b admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:36.868951 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aea380-efbd-4e3e-9c4a-b946bf4b3c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:36.869676 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea380-efbd-4e3e-9c4a-b946bf4b3c21 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:36.870071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea380-efbd-4e3e-9c4a-b946bf4b3c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:36.870347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea380-efbd-4e3e-9c4a-b946bf4b3c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:36.880667 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aea380-efbd-4e3e-9c4a-b946bf4b3c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:36.887541 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aea380-efbd-4e3e-9c4a-b946bf4b3c21 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:36.896157 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1403/2802] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:37.479950 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e676d-d324-4bcc-863a-3409fc802ca1 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:37.482263 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-ff9e676d-d324-4bcc-863a-3409fc802ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:37.496863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e676d-d324-4bcc-863a-3409fc802ca1 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:37.507318 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:37.508377 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:37.508827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:37.509410 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] PATH_INFO: `/v3/projects/a4b7d3b816e542588105fd541e9895bc` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:37.511421 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b7d3b816e542588105fd541e9895bc)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:37.513584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:37.611478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b7d3b816e542588105fd541e9895bc', 'request_id': 'req-483c20bc-49c6-4603-936b-e0e49e274db4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:37.620269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b7d3b816e542588105fd541e9895bc', 'request_id': 'req-483c20bc-49c6-4603-936b-e0e49e274db4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:37.631458 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b7d3b816e542588105fd541e9895bc', 'request_id': 'req-483c20bc-49c6-4603-936b-e0e49e274db4'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:37.648590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] The token cache is being invalidate because project a4b7d3b816e542588105fd541e9895bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:37.648928 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:37.649805 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:37.651710 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1400/2803] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:37 2022] DELETE /identity/v3/projects/a4b7d3b816e542588105fd541e9895bc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:39.812548 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aea380-efbd-4e3e-9c4a-b946bf4b3c21 service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:39.814203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f2aea380-efbd-4e3e-9c4a-b946bf4b3c21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:39.874526 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:39.876403 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:39.929551 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aea380-efbd-4e3e-9c4a-b946bf4b3c21 service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:39.951827 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c20bc-49c6-4603-936b-e0e49e274db4 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:39.957157 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:39.957834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:39.958112 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:39.958379 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] PATH_INFO: `/v3/users/ccd5adafa7b0465988e758ebe7b29dc2` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:39.959578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd5adafa7b0465988e758ebe7b29dc2)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:39.961494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:39.981129 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:39.999164 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366c36a-cd8e-42b9-8982-37bc07800b1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:39.999582 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c36a-cd8e-42b9-8982-37bc07800b1d service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:39.999861 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c36a-cd8e-42b9-8982-37bc07800b1d service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:40.000130 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c36a-cd8e-42b9-8982-37bc07800b1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:40.001968 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9366c36a-cd8e-42b9-8982-37bc07800b1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:40.015922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c36a-cd8e-42b9-8982-37bc07800b1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:40.017586 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c36a-cd8e-42b9-8982-37bc07800b1d service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:40.026425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd5adafa7b0465988e758ebe7b29dc2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.027145 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd5adafa7b0465988e758ebe7b29dc2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.028971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1404/2804] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:47:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:47:40.044388 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd5adafa7b0465988e758ebe7b29dc2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.053184 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd5adafa7b0465988e758ebe7b29dc2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.053995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd5adafa7b0465988e758ebe7b29dc2'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.068147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1401/2805] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:39 2022] DELETE /identity/v3/users/ccd5adafa7b0465988e758ebe7b29dc2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:40.255660 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366c36a-cd8e-42b9-8982-37bc07800b1d service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:40.261210 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:40.268457 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366c36a-cd8e-42b9-8982-37bc07800b1d service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:40.453839 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:40.454486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:40.454759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:40.455052 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] PATH_INFO: `/v3/projects/fa6d3ceabd634b67bdbb5e3d5af9bd0d` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:40.456249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6d3ceabd634b67bdbb5e3d5af9bd0d)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:40.458159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:40.506199 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6d3ceabd634b67bdbb5e3d5af9bd0d', 'request_id': 'req-e7b1afcb-8456-4dab-8437-fa5c01228add'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.512638 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6d3ceabd634b67bdbb5e3d5af9bd0d', 'request_id': 'req-e7b1afcb-8456-4dab-8437-fa5c01228add'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.522402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6d3ceabd634b67bdbb5e3d5af9bd0d', 'request_id': 'req-e7b1afcb-8456-4dab-8437-fa5c01228add'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.533205 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] The token cache is being invalidate because project fa6d3ceabd634b67bdbb5e3d5af9bd0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:40.533494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.534143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.535699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1405/2806] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:40 2022] DELETE /identity/v3/projects/fa6d3ceabd634b67bdbb5e3d5af9bd0d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:40.540460 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:40.542425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:40.555971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39740a28-4826-48c3-92c2-9c999af6d6c8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:40.623107 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:40.623820 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:40.624620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:40.624897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] PATH_INFO: `/v3/users/3f27f24f0676479a9b5869f8cc425cb3` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:40.626155 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f27f24f0676479a9b5869f8cc425cb3)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:40.628261 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:40.676930 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f27f24f0676479a9b5869f8cc425cb3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.677579 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f27f24f0676479a9b5869f8cc425cb3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.690544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f27f24f0676479a9b5869f8cc425cb3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.701525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f27f24f0676479a9b5869f8cc425cb3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.702244 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-8f041d76-1b7a-447b-8932-f470e7e0eb43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f27f24f0676479a9b5869f8cc425cb3'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:40.722545 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1402/2807] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:47:40 2022] DELETE /identity/v3/users/3f27f24f0676479a9b5869f8cc425cb3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:40.907379 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:47:40.909672 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:47:40.926789 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1afcb-8456-4dab-8437-fa5c01228add admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:47:40.987347 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:47:40.987988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:47:40.988265 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:47:40.988537 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] PATH_INFO: `/v3/projects/6cd97299ae5c45ec95c094c080b69991` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:47:40.989705 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd97299ae5c45ec95c094c080b69991)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:47:40.991634 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:47:41.031807 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:41.047035 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd97299ae5c45ec95c094c080b69991', 'request_id': 'req-fe194bd0-61e4-4246-85d4-f0277a889625'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:41.052773 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd97299ae5c45ec95c094c080b69991', 'request_id': 'req-fe194bd0-61e4-4246-85d4-f0277a889625'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:41.060775 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd97299ae5c45ec95c094c080b69991', 'request_id': 'req-fe194bd0-61e4-4246-85d4-f0277a889625'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:41.072355 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] The token cache is being invalidate because project 6cd97299ae5c45ec95c094c080b69991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:47:41.072640 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:41.073307 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:47:41.074838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1406/2808] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:47:40 2022] DELETE /identity/v3/projects/6cd97299ae5c45ec95c094c080b69991 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:47:50.718847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=74,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:47:51.069152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:12.715637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87c9b-33a6-44c2-90cf-ec5eb577821a None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:48:12.716212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87c9b-33a6-44c2-90cf-ec5eb577821a None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:48:12.716212 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87c9b-33a6-44c2-90cf-ec5eb577821a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:48:12.737161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-01c87c9b-33a6-44c2-90cf-ec5eb577821a None None] MFA Rules not processed for user `54eecc3a8e054a0bbe0fd68e1aa85238`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:48:12.738381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-01c87c9b-33a6-44c2-90cf-ec5eb577821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:48:12.797824 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1403/2809] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:48:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:48:22.790968 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=25 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:48:36.684520 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:48:36.685930 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:48:36.835844 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe194bd0-61e4-4246-85d4-f0277a889625 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:48:36.841005 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:48:36.841614 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:48:36.841898 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:48:36.842172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:48:36.843982 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:48:36.856411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:48:36.857994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:48:36.868566 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1407/2810] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:48:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:48:46.863988 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=63 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:49:11.092699 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd1a1-e45d-444c-a0ad-e6e640e7db47 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:49:11.093280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd1a1-e45d-444c-a0ad-e6e640e7db47 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:49:11.093280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd1a1-e45d-444c-a0ad-e6e640e7db47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:49:11.112216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b2dcd1a1-e45d-444c-a0ad-e6e640e7db47 None None] MFA Rules not processed for user `54eecc3a8e054a0bbe0fd68e1aa85238`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:49:11.113414 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b2dcd1a1-e45d-444c-a0ad-e6e640e7db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:49:11.121258 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1404/2811] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:49:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:49:21.107247 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:10.952512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:10.953972 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:11.050687 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a546d7-55c0-4d15-bd4b-24b2d2a8ccc5 service placement] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:11.055333 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:11.056028 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.056317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.056590 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] PATH_INFO: `/v3/users/54eecc3a8e054a0bbe0fd68e1aa85238` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.057774 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54eecc3a8e054a0bbe0fd68e1aa85238)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:11.059840 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:11.107899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54eecc3a8e054a0bbe0fd68e1aa85238'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.108550 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54eecc3a8e054a0bbe0fd68e1aa85238'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.120241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54eecc3a8e054a0bbe0fd68e1aa85238'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.127139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54eecc3a8e054a0bbe0fd68e1aa85238'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.134311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-c64ad5d1-3ef3-4d52-8fc1-be4c2b15f941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54eecc3a8e054a0bbe0fd68e1aa85238'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.140353 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1408/2812] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:50:10 2022] DELETE /identity/v3/users/54eecc3a8e054a0bbe0fd68e1aa85238 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:11.317472 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd1a1-e45d-444c-a0ad-e6e640e7db47 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:11.329193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd1a1-e45d-444c-a0ad-e6e640e7db47 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:11.386690 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:11.387354 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.387648 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.387923 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] PATH_INFO: `/v3/projects/aa49912426e5451bbbec6a6907ea73b2` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.389069 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa49912426e5451bbbec6a6907ea73b2)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:11.390971 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:11.436267 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa49912426e5451bbbec6a6907ea73b2', 'request_id': 'req-00206898-b447-4f6d-80f0-12a9c8f07a83'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.441637 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa49912426e5451bbbec6a6907ea73b2', 'request_id': 'req-00206898-b447-4f6d-80f0-12a9c8f07a83'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.449401 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa49912426e5451bbbec6a6907ea73b2', 'request_id': 'req-00206898-b447-4f6d-80f0-12a9c8f07a83'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.460338 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] The token cache is being invalidate because project aa49912426e5451bbbec6a6907ea73b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:50:11.461277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.462238 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-00206898-b447-4f6d-80f0-12a9c8f07a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:11.464115 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1405/2813] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:50:11 2022] DELETE /identity/v3/projects/aa49912426e5451bbbec6a6907ea73b2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:11.470529 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cfbad-5cb4-4a51-ad2c-535d154cf6a7 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.470855 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cfbad-5cb4-4a51-ad2c-535d154cf6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.471168 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cfbad-5cb4-4a51-ad2c-535d154cf6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.529949 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c79cfbad-5cb4-4a51-ad2c-535d154cf6a7 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:11.531220 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c79cfbad-5cb4-4a51-ad2c-535d154cf6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:11.551295 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:11.605577 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1409/2814] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:50:11.613193 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063db88f-f840-43b5-a512-1538e4374612 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.613480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063db88f-f840-43b5-a512-1538e4374612 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.613750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063db88f-f840-43b5-a512-1538e4374612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.633524 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-063db88f-f840-43b5-a512-1538e4374612 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:11.634711 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-063db88f-f840-43b5-a512-1538e4374612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:11.643681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1406/2815] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:11.648074 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cfbad-5cb4-4a51-ad2c-535d154cf6a7 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:11.658792 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cfbad-5cb4-4a51-ad2c-535d154cf6a7 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:11.663568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaebe4-2a28-40ac-a9e9-e8c923c4f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:11.664208 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaebe4-2a28-40ac-a9e9-e8c923c4f40a admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.664483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaebe4-2a28-40ac-a9e9-e8c923c4f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.664751 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaebe4-2a28-40ac-a9e9-e8c923c4f40a admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.665434 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaebe4-2a28-40ac-a9e9-e8c923c4f40a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:50:11.665730 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaebe4-2a28-40ac-a9e9-e8c923c4f40a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:11.667366 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaebe4-2a28-40ac-a9e9-e8c923c4f40a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:11.680051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1410/2816] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:50:11.684418 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063db88f-f840-43b5-a512-1538e4374612 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:11.693979 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063db88f-f840-43b5-a512-1538e4374612 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:11.699384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5df780-a73a-4890-b073-33ecf7ae937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:11.699995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5df780-a73a-4890-b073-33ecf7ae937a admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.700396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5df780-a73a-4890-b073-33ecf7ae937a admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.700576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5df780-a73a-4890-b073-33ecf7ae937a admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.701256 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5df780-a73a-4890-b073-33ecf7ae937a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:11.705343 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5df780-a73a-4890-b073-33ecf7ae937a admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:11.745057 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1407/2817] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:50:11 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:50:11.749195 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaebe4-2a28-40ac-a9e9-e8c923c4f40a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:11.765639 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaebe4-2a28-40ac-a9e9-e8c923c4f40a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:11.827116 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91c354-64e5-4683-8865-fad4b5f5e740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:11.827884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91c354-64e5-4683-8865-fad4b5f5e740 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.828230 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91c354-64e5-4683-8865-fad4b5f5e740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.828681 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91c354-64e5-4683-8865-fad4b5f5e740 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.829578 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91c354-64e5-4683-8865-fad4b5f5e740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:11.831589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91c354-64e5-4683-8865-fad4b5f5e740 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:11.858941 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1411/2818] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:50:11 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:50:11.860823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5df780-a73a-4890-b073-33ecf7ae937a admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:11.873644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5df780-a73a-4890-b073-33ecf7ae937a admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:11.879168 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e2af-12b4-475a-8c06-fa0c2a89ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:11.879955 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e2af-12b4-475a-8c06-fa0c2a89ea46 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.880323 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e2af-12b4-475a-8c06-fa0c2a89ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.880605 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e2af-12b4-475a-8c06-fa0c2a89ea46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.881409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6e2af-12b4-475a-8c06-fa0c2a89ea46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:11.883644 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6e2af-12b4-475a-8c06-fa0c2a89ea46 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:11.898415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1408/2819] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:11.899589 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91c354-64e5-4683-8865-fad4b5f5e740 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:11.910054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91c354-64e5-4683-8865-fad4b5f5e740 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:11.915387 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2ee36-476b-41d2-b562-0f702b7186e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:11.916128 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2ee36-476b-41d2-b562-0f702b7186e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.916411 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2ee36-476b-41d2-b562-0f702b7186e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.916685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2ee36-476b-41d2-b562-0f702b7186e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.917382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2ee36-476b-41d2-b562-0f702b7186e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:11.919099 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2ee36-476b-41d2-b562-0f702b7186e2 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:11.930361 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1412/2820] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:50:11.935017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e2af-12b4-475a-8c06-fa0c2a89ea46 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:11.945700 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e2af-12b4-475a-8c06-fa0c2a89ea46 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:11.950627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8478c86-523d-47f7-bcb4-94ebc84eb0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:11.951340 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478c86-523d-47f7-bcb4-94ebc84eb0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.951620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478c86-523d-47f7-bcb4-94ebc84eb0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.951896 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478c86-523d-47f7-bcb4-94ebc84eb0e3 admin admin] PATH_INFO: `/v3/projects/1a6ec61e7cbf4d36ba0fdc751b9be84b/users/7e79a54e9bdf4f60b55eb77cac758c8e/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:11.967223 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8478c86-523d-47f7-bcb4-94ebc84eb0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6ec61e7cbf4d36ba0fdc751b9be84b, user_id=7e79a54e9bdf4f60b55eb77cac758c8e, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:11.969969 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8478c86-523d-47f7-bcb4-94ebc84eb0e3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:11.983413 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1409/2821] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:50:11 2022] PUT /identity/v3/projects/1a6ec61e7cbf4d36ba0fdc751b9be84b/users/7e79a54e9bdf4f60b55eb77cac758c8e/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:11.994460 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c379e-0339-428c-a6f4-77de6bee0877 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:11.994937 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c379e-0339-428c-a6f4-77de6bee0877 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:11.995185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c379e-0339-428c-a6f4-77de6bee0877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:12.022647 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-857c379e-0339-428c-a6f4-77de6bee0877 None None] MFA Rules not processed for user `7e79a54e9bdf4f60b55eb77cac758c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:12.023900 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-857c379e-0339-428c-a6f4-77de6bee0877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:12.088421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1413/2822] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:12.099298 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8478c86-523d-47f7-bcb4-94ebc84eb0e3 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:12.101053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a8478c86-523d-47f7-bcb4-94ebc84eb0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:12.135915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:12.185197 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8478c86-523d-47f7-bcb4-94ebc84eb0e3 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:12.188840 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f1afa-df57-4381-a309-2692e2886a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:12.189453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1afa-df57-4381-a309-2692e2886a7c service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:12.189736 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1afa-df57-4381-a309-2692e2886a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:12.190011 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1afa-df57-4381-a309-2692e2886a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:12.198229 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f1afa-df57-4381-a309-2692e2886a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:12.199624 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f1afa-df57-4381-a309-2692e2886a7c service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:12.208292 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1410/2823] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:20.684970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c379e-0339-428c-a6f4-77de6bee0877 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:20.702419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:20.749190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c379e-0339-428c-a6f4-77de6bee0877 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:20.753733 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:20.754371 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:20.754652 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:20.754924 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] PATH_INFO: `/v3/users/7e79a54e9bdf4f60b55eb77cac758c8e` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:20.756109 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e79a54e9bdf4f60b55eb77cac758c8e)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:20.758697 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:20.805536 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e79a54e9bdf4f60b55eb77cac758c8e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:20.806189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e79a54e9bdf4f60b55eb77cac758c8e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:20.818821 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e79a54e9bdf4f60b55eb77cac758c8e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:20.826329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e79a54e9bdf4f60b55eb77cac758c8e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:20.833198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e79a54e9bdf4f60b55eb77cac758c8e'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:20.839225 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1414/2824] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:50:20 2022] DELETE /identity/v3/users/7e79a54e9bdf4f60b55eb77cac758c8e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:20.843763 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64787a0d-fd9b-4589-bb12-91a1096a9497 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:20.844338 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64787a0d-fd9b-4589-bb12-91a1096a9497 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:20.844454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64787a0d-fd9b-4589-bb12-91a1096a9497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:20.863216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-64787a0d-fd9b-4589-bb12-91a1096a9497 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:20.864409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-64787a0d-fd9b-4589-bb12-91a1096a9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:20.923961 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1411/2825] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:50:20.933907 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:20.935430 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:21.012345 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2170d2-8568-44f4-8614-2f777f90566d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:21.015926 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513bffa-0026-4c0c-a106-0673b57b52d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:21.016528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513bffa-0026-4c0c-a106-0673b57b52d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.016803 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513bffa-0026-4c0c-a106-0673b57b52d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.017069 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513bffa-0026-4c0c-a106-0673b57b52d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.026468 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513bffa-0026-4c0c-a106-0673b57b52d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:21.027922 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513bffa-0026-4c0c-a106-0673b57b52d4 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:21.037701 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1415/2826] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:21.302308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64787a0d-fd9b-4589-bb12-91a1096a9497 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:21.303769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-64787a0d-fd9b-4589-bb12-91a1096a9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:21.317292 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64787a0d-fd9b-4589-bb12-91a1096a9497 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:21.322381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:21.323053 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.323334 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.323606 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] PATH_INFO: `/v3/projects/1a6ec61e7cbf4d36ba0fdc751b9be84b` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.324758 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6ec61e7cbf4d36ba0fdc751b9be84b)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:21.326672 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:21.377216 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6ec61e7cbf4d36ba0fdc751b9be84b', 'request_id': 'req-182f64e5-5725-4b7e-93f4-63e67c3f95a9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:21.383456 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6ec61e7cbf4d36ba0fdc751b9be84b', 'request_id': 'req-182f64e5-5725-4b7e-93f4-63e67c3f95a9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:21.391621 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6ec61e7cbf4d36ba0fdc751b9be84b', 'request_id': 'req-182f64e5-5725-4b7e-93f4-63e67c3f95a9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:21.403660 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] The token cache is being invalidate because project 1a6ec61e7cbf4d36ba0fdc751b9be84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:50:21.403940 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:21.404836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-182f64e5-5725-4b7e-93f4-63e67c3f95a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:21.406353 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1412/2827] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:50:21 2022] DELETE /identity/v3/projects/1a6ec61e7cbf4d36ba0fdc751b9be84b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:21.412218 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988d3d-ceaa-4b89-969b-19045f5180c3 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.412534 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988d3d-ceaa-4b89-969b-19045f5180c3 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.412812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988d3d-ceaa-4b89-969b-19045f5180c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.432399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c4988d3d-ceaa-4b89-969b-19045f5180c3 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:21.433592 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c4988d3d-ceaa-4b89-969b-19045f5180c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:21.445983 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:21.492712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1416/2828] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:21.500319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e742-af9e-4ae3-accb-d61be3532e15 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.500603 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e742-af9e-4ae3-accb-d61be3532e15 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.500872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e742-af9e-4ae3-accb-d61be3532e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.522904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-fd93e742-af9e-4ae3-accb-d61be3532e15 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:21.524208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-fd93e742-af9e-4ae3-accb-d61be3532e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:21.532249 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1413/2829] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:50:21.536439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988d3d-ceaa-4b89-969b-19045f5180c3 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:21.546030 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988d3d-ceaa-4b89-969b-19045f5180c3 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:21.551838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9e9f1-aa1d-484b-bbe8-a8216fd06f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:21.552669 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9e9f1-aa1d-484b-bbe8-a8216fd06f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.553114 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9e9f1-aa1d-484b-bbe8-a8216fd06f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.553389 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9e9f1-aa1d-484b-bbe8-a8216fd06f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.554140 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9e9f1-aa1d-484b-bbe8-a8216fd06f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:50:21.554945 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9e9f1-aa1d-484b-bbe8-a8216fd06f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:21.556587 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9e9f1-aa1d-484b-bbe8-a8216fd06f42 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:21.568334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1417/2830] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:50:21.573520 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93e742-af9e-4ae3-accb-d61be3532e15 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:21.582838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93e742-af9e-4ae3-accb-d61be3532e15 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:21.593004 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80d014-da71-4fe9-97e2-dba5d07c37ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:21.593588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80d014-da71-4fe9-97e2-dba5d07c37ce admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.593873 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80d014-da71-4fe9-97e2-dba5d07c37ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.594147 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80d014-da71-4fe9-97e2-dba5d07c37ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.594821 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80d014-da71-4fe9-97e2-dba5d07c37ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:21.596752 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80d014-da71-4fe9-97e2-dba5d07c37ce admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:21.622348 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:21.637685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1414/2831] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:50:21 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:50:21.641810 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9e9f1-aa1d-484b-bbe8-a8216fd06f42 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:21.651713 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9e9f1-aa1d-484b-bbe8-a8216fd06f42 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:21.708051 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66413-653c-43a3-9f83-dfeb52ff2794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:21.708679 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66413-653c-43a3-9f83-dfeb52ff2794 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.708846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66413-653c-43a3-9f83-dfeb52ff2794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.709142 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66413-653c-43a3-9f83-dfeb52ff2794 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.709786 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e66413-653c-43a3-9f83-dfeb52ff2794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:21.711725 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e66413-653c-43a3-9f83-dfeb52ff2794 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:21.733420 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1418/2832] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:50:21 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:50:21.737532 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80d014-da71-4fe9-97e2-dba5d07c37ce admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:21.748465 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80d014-da71-4fe9-97e2-dba5d07c37ce admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:21.753134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef3aed-9f4d-40f9-82ba-0baa426f4280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:21.753681 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef3aed-9f4d-40f9-82ba-0baa426f4280 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.753959 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef3aed-9f4d-40f9-82ba-0baa426f4280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.754232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef3aed-9f4d-40f9-82ba-0baa426f4280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.754962 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef3aed-9f4d-40f9-82ba-0baa426f4280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:21.756576 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef3aed-9f4d-40f9-82ba-0baa426f4280 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:21.767271 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1415/2833] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 04:50:21.771213 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66413-653c-43a3-9f83-dfeb52ff2794 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:21.781402 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66413-653c-43a3-9f83-dfeb52ff2794 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:21.785869 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54012a5a-5587-4a2a-ab46-de491b35755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:21.786461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54012a5a-5587-4a2a-ab46-de491b35755c admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.786735 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54012a5a-5587-4a2a-ab46-de491b35755c admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.787023 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54012a5a-5587-4a2a-ab46-de491b35755c admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.787798 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54012a5a-5587-4a2a-ab46-de491b35755c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:21.789846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54012a5a-5587-4a2a-ab46-de491b35755c admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:21.800031 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1419/2834] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:21.803931 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef3aed-9f4d-40f9-82ba-0baa426f4280 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:21.814454 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef3aed-9f4d-40f9-82ba-0baa426f4280 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:21.819000 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b937b4d-5634-442f-b7e6-710d336fe3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:21.819649 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937b4d-5634-442f-b7e6-710d336fe3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.819927 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937b4d-5634-442f-b7e6-710d336fe3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.820200 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937b4d-5634-442f-b7e6-710d336fe3a6 admin admin] PATH_INFO: `/v3/projects/3bcd64ad0c244bdfb7be0ba00b44f949/users/14cd10be70ae414bbbb34af63d3715c7/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.834419 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b937b4d-5634-442f-b7e6-710d336fe3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bcd64ad0c244bdfb7be0ba00b44f949, user_id=14cd10be70ae414bbbb34af63d3715c7, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:21.837075 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b937b4d-5634-442f-b7e6-710d336fe3a6 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:21.849952 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1416/2835] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:50:21 2022] PUT /identity/v3/projects/3bcd64ad0c244bdfb7be0ba00b44f949/users/14cd10be70ae414bbbb34af63d3715c7/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:50:21.860836 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f776b3-cf4e-408e-a891-cf6cadf0fd0c None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:21.861221 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f776b3-cf4e-408e-a891-cf6cadf0fd0c None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:21.861458 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f776b3-cf4e-408e-a891-cf6cadf0fd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:21.891698 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-a5f776b3-cf4e-408e-a891-cf6cadf0fd0c None None] MFA Rules not processed for user `14cd10be70ae414bbbb34af63d3715c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:21.892906 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-a5f776b3-cf4e-408e-a891-cf6cadf0fd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:21.954569 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1420/2836] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:21.968166 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b937b4d-5634-442f-b7e6-710d336fe3a6 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:21.970105 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-4b937b4d-5634-442f-b7e6-710d336fe3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:22.071801 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b937b4d-5634-442f-b7e6-710d336fe3a6 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:22.077387 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ec807-421b-4e6a-a7ef-89d68f62fa70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd26e2ac2578438e854d51d8eed26463', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:22.077997 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ec807-421b-4e6a-a7ef-89d68f62fa70 service nova] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:22.078280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ec807-421b-4e6a-a7ef-89d68f62fa70 service nova] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:22.078555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ec807-421b-4e6a-a7ef-89d68f62fa70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:22.086211 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ec807-421b-4e6a-a7ef-89d68f62fa70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:22.087814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ec807-421b-4e6a-a7ef-89d68f62fa70 service nova] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:22.096543 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1417/2837] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:22.296748 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f776b3-cf4e-408e-a891-cf6cadf0fd0c None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:22.309415 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:22.359617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f776b3-cf4e-408e-a891-cf6cadf0fd0c None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:22.365117 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:22.365753 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:22.366024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:22.366291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] PATH_INFO: `/v3/users/14cd10be70ae414bbbb34af63d3715c7` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:22.367645 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14cd10be70ae414bbbb34af63d3715c7)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:22.369886 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:22.418831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14cd10be70ae414bbbb34af63d3715c7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:22.419845 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14cd10be70ae414bbbb34af63d3715c7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:22.433171 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14cd10be70ae414bbbb34af63d3715c7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:22.439995 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14cd10be70ae414bbbb34af63d3715c7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:22.447422 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14cd10be70ae414bbbb34af63d3715c7'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:22.453311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1421/2838] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:50:22 2022] DELETE /identity/v3/users/14cd10be70ae414bbbb34af63d3715c7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:22.457784 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ad73-440c-4055-8292-a27e52153f5d None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:22.458068 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ad73-440c-4055-8292-a27e52153f5d None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:22.458363 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ad73-440c-4055-8292-a27e52153f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:22.478679 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a027ad73-440c-4055-8292-a27e52153f5d None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:22.479847 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a027ad73-440c-4055-8292-a27e52153f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:22.537915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1418/2839] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:22.547611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:22.549139 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:22.604884 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395058da-4676-45e2-9db4-05753377c05a admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:22.608444 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa456ec9-0b60-40ab-976f-1bbe9aae7bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:22.609049 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456ec9-0b60-40ab-976f-1bbe9aae7bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:22.609323 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456ec9-0b60-40ab-976f-1bbe9aae7bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:22.609595 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa456ec9-0b60-40ab-976f-1bbe9aae7bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:22.618342 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa456ec9-0b60-40ab-976f-1bbe9aae7bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:22.619772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa456ec9-0b60-40ab-976f-1bbe9aae7bf8 service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:22.628934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1422/2840] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:22.906759 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027ad73-440c-4055-8292-a27e52153f5d None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:22.908272 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a027ad73-440c-4055-8292-a27e52153f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:22.920242 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027ad73-440c-4055-8292-a27e52153f5d None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:22.924974 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:22.925620 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:22.925921 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:22.926174 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] PATH_INFO: `/v3/projects/3bcd64ad0c244bdfb7be0ba00b44f949` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:22.927734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bcd64ad0c244bdfb7be0ba00b44f949)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:22.929774 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:22.946396 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:22.977915 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bcd64ad0c244bdfb7be0ba00b44f949', 'request_id': 'req-78d11dda-2026-4344-ad4b-9f754183d5c9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:22.983473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bcd64ad0c244bdfb7be0ba00b44f949', 'request_id': 'req-78d11dda-2026-4344-ad4b-9f754183d5c9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:22.991243 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bcd64ad0c244bdfb7be0ba00b44f949', 'request_id': 'req-78d11dda-2026-4344-ad4b-9f754183d5c9'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:23.005089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] The token cache is being invalidate because project 3bcd64ad0c244bdfb7be0ba00b44f949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:50:23.005089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:23.005089 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-78d11dda-2026-4344-ad4b-9f754183d5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:23.005673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1419/2841] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:50:22 2022] DELETE /identity/v3/projects/3bcd64ad0c244bdfb7be0ba00b44f949 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:23.013685 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b0d8-2e6e-488c-8acb-381b25d9a9a2 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.014159 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b0d8-2e6e-488c-8acb-381b25d9a9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.014358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b0d8-2e6e-488c-8acb-381b25d9a9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.034999 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-9830b0d8-2e6e-488c-8acb-381b25d9a9a2 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:23.036188 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-9830b0d8-2e6e-488c-8acb-381b25d9a9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:23.066483 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:23.097637 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1423/2842] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:50:23.106588 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b9b1b-e92d-49c6-a08c-fec10dd632f5 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.106872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b9b1b-e92d-49c6-a08c-fec10dd632f5 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.107178 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b9b1b-e92d-49c6-a08c-fec10dd632f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.127141 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-416b9b1b-e92d-49c6-a08c-fec10dd632f5 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:23.128337 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-416b9b1b-e92d-49c6-a08c-fec10dd632f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:23.136802 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1420/2843] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:23.140942 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830b0d8-2e6e-488c-8acb-381b25d9a9a2 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.150418 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830b0d8-2e6e-488c-8acb-381b25d9a9a2 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.155291 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa4967-8134-4ba5-92e4-441afbfa6dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.155891 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4967-8134-4ba5-92e4-441afbfa6dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.156167 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4967-8134-4ba5-92e4-441afbfa6dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.156433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4967-8134-4ba5-92e4-441afbfa6dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.157113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa4967-8134-4ba5-92e4-441afbfa6dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:50:23.157413 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa4967-8134-4ba5-92e4-441afbfa6dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.158996 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa4967-8134-4ba5-92e4-441afbfa6dd9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.170237 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1424/2844] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 04:50:23.174277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b9b1b-e92d-49c6-a08c-fec10dd632f5 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.183822 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b9b1b-e92d-49c6-a08c-fec10dd632f5 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.188479 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03413d19-cbad-48d0-bc39-7ea32fa318f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.189081 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03413d19-cbad-48d0-bc39-7ea32fa318f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.189358 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03413d19-cbad-48d0-bc39-7ea32fa318f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.189629 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03413d19-cbad-48d0-bc39-7ea32fa318f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.190315 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03413d19-cbad-48d0-bc39-7ea32fa318f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.192232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03413d19-cbad-48d0-bc39-7ea32fa318f2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.219153 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1421/2845] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:50:23 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:50:23.223258 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa4967-8134-4ba5-92e4-441afbfa6dd9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.233308 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa4967-8134-4ba5-92e4-441afbfa6dd9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.289852 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b564911-86d9-4114-a028-ba766c841e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.290465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b564911-86d9-4114-a028-ba766c841e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.290749 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b564911-86d9-4114-a028-ba766c841e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.291093 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b564911-86d9-4114-a028-ba766c841e01 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.291754 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b564911-86d9-4114-a028-ba766c841e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.293724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b564911-86d9-4114-a028-ba766c841e01 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.314473 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1425/2846] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:50:23 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:50:23.318544 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03413d19-cbad-48d0-bc39-7ea32fa318f2 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.328584 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03413d19-cbad-48d0-bc39-7ea32fa318f2 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.333171 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2cecb-6404-4ef1-b636-52e0e1ecc47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.333770 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2cecb-6404-4ef1-b636-52e0e1ecc47c admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.334045 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2cecb-6404-4ef1-b636-52e0e1ecc47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.334314 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2cecb-6404-4ef1-b636-52e0e1ecc47c admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.335017 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2cecb-6404-4ef1-b636-52e0e1ecc47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.336608 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2cecb-6404-4ef1-b636-52e0e1ecc47c admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.346389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1422/2847] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:23.350189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b564911-86d9-4114-a028-ba766c841e01 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.360811 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b564911-86d9-4114-a028-ba766c841e01 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.365568 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a8de1-ab7a-493d-b76c-04bfe85314a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.366209 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a8de1-ab7a-493d-b76c-04bfe85314a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.366490 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a8de1-ab7a-493d-b76c-04bfe85314a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.367438 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a8de1-ab7a-493d-b76c-04bfe85314a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.368150 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a8de1-ab7a-493d-b76c-04bfe85314a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.369777 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a8de1-ab7a-493d-b76c-04bfe85314a9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.380934 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1426/2848] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:23.385462 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2cecb-6404-4ef1-b636-52e0e1ecc47c admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.395750 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2cecb-6404-4ef1-b636-52e0e1ecc47c admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.400521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7188-0019-477d-b5a5-274f8c7d42c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.401182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7188-0019-477d-b5a5-274f8c7d42c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.401466 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7188-0019-477d-b5a5-274f8c7d42c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.401742 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7188-0019-477d-b5a5-274f8c7d42c8 admin admin] PATH_INFO: `/v3/projects/67823bd0fb0e4e8f86048dfc9cc591fd/users/f67600594f334fb79b58fc0de897ccc6/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.417225 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7188-0019-477d-b5a5-274f8c7d42c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67823bd0fb0e4e8f86048dfc9cc591fd, user_id=f67600594f334fb79b58fc0de897ccc6, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.419902 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7188-0019-477d-b5a5-274f8c7d42c8 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.432772 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1423/2849] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:50:23 2022] PUT /identity/v3/projects/67823bd0fb0e4e8f86048dfc9cc591fd/users/f67600594f334fb79b58fc0de897ccc6/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:23.442927 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a05eb-622b-466c-80a0-99ec3afb9aa4 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.443249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a05eb-622b-466c-80a0-99ec3afb9aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.443523 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a05eb-622b-466c-80a0-99ec3afb9aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.470198 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-f88a05eb-622b-466c-80a0-99ec3afb9aa4 None None] MFA Rules not processed for user `f67600594f334fb79b58fc0de897ccc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:23.471433 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-f88a05eb-622b-466c-80a0-99ec3afb9aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:23.536186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1427/2850] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 04:50:23.541436 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7188-0019-477d-b5a5-274f8c7d42c8 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.607512 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7188-0019-477d-b5a5-274f8c7d42c8 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.613142 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abba562-fb20-4ed0-923d-16578e94385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.613761 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abba562-fb20-4ed0-923d-16578e94385f admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.614044 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abba562-fb20-4ed0-923d-16578e94385f admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.614316 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abba562-fb20-4ed0-923d-16578e94385f admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.615005 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abba562-fb20-4ed0-923d-16578e94385f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.617470 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abba562-fb20-4ed0-923d-16578e94385f admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.643633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1424/2851] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:50:23 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:50:23.647560 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a05eb-622b-466c-80a0-99ec3afb9aa4 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.658998 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a05eb-622b-466c-80a0-99ec3afb9aa4 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.687334 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:23.715964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38e1ad-d381-48d3-8658-99a5c8ccec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.716567 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38e1ad-d381-48d3-8658-99a5c8ccec87 admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.716842 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38e1ad-d381-48d3-8658-99a5c8ccec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.717108 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38e1ad-d381-48d3-8658-99a5c8ccec87 admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.717759 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38e1ad-d381-48d3-8658-99a5c8ccec87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.719674 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38e1ad-d381-48d3-8658-99a5c8ccec87 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.740496 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1428/2852] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:50:23 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:50:23.744425 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abba562-fb20-4ed0-923d-16578e94385f admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.754577 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abba562-fb20-4ed0-923d-16578e94385f admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.759564 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1b356-231d-4690-a56c-13ccec365a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.759838 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1b356-231d-4690-a56c-13ccec365a37 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.760118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1b356-231d-4690-a56c-13ccec365a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.760394 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1b356-231d-4690-a56c-13ccec365a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.761082 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1b356-231d-4690-a56c-13ccec365a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.762709 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1b356-231d-4690-a56c-13ccec365a37 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.773863 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1425/2853] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:23.777932 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38e1ad-d381-48d3-8658-99a5c8ccec87 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.787812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38e1ad-d381-48d3-8658-99a5c8ccec87 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.792964 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a81741-dadb-4049-b7b2-6be71f1d2938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.793633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a81741-dadb-4049-b7b2-6be71f1d2938 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.793905 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a81741-dadb-4049-b7b2-6be71f1d2938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.794172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a81741-dadb-4049-b7b2-6be71f1d2938 admin admin] PATH_INFO: `/v3/projects/f0e3317a34e542a9a829f2f17b7563eb/users/9207d84de933486d97678ed623491335/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.808372 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a81741-dadb-4049-b7b2-6be71f1d2938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e3317a34e542a9a829f2f17b7563eb, user_id=9207d84de933486d97678ed623491335, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.811080 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a81741-dadb-4049-b7b2-6be71f1d2938 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.824079 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1429/2854] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:50:23 2022] PUT /identity/v3/projects/f0e3317a34e542a9a829f2f17b7563eb/users/9207d84de933486d97678ed623491335/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:23.827996 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1b356-231d-4690-a56c-13ccec365a37 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.838897 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1b356-231d-4690-a56c-13ccec365a37 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.847793 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:23.897206 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cb084-378c-4ef4-946c-c12dac827b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.897820 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cb084-378c-4ef4-946c-c12dac827b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.898590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cb084-378c-4ef4-946c-c12dac827b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.898864 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cb084-378c-4ef4-946c-c12dac827b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.899604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cb084-378c-4ef4-946c-c12dac827b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.901190 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cb084-378c-4ef4-946c-c12dac827b01 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.911228 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1426/2855] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:23.916092 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a81741-dadb-4049-b7b2-6be71f1d2938 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:23.926546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a81741-dadb-4049-b7b2-6be71f1d2938 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:23.931097 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ab83f-36bf-4306-ba67-c0dc672f11e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:23.931772 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ab83f-36bf-4306-ba67-c0dc672f11e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.932048 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ab83f-36bf-4306-ba67-c0dc672f11e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.932317 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ab83f-36bf-4306-ba67-c0dc672f11e9 admin admin] PATH_INFO: `/v3/projects/f0e3317a34e542a9a829f2f17b7563eb/users/9207d84de933486d97678ed623491335/roles/c1429555635349208e8b2bd908436746` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.934259 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ab83f-36bf-4306-ba67-c0dc672f11e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e3317a34e542a9a829f2f17b7563eb, user_id=9207d84de933486d97678ed623491335, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:23.937113 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ab83f-36bf-4306-ba67-c0dc672f11e9 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:23.947120 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1430/2856] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:50:23 2022] PUT /identity/v3/projects/f0e3317a34e542a9a829f2f17b7563eb/users/9207d84de933486d97678ed623491335/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:23.958277 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50540c1b-36b3-4197-86de-6ad54687e245 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:23.958565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50540c1b-36b3-4197-86de-6ad54687e245 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:23.958839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50540c1b-36b3-4197-86de-6ad54687e245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:23.987163 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-50540c1b-36b3-4197-86de-6ad54687e245 None None] MFA Rules not processed for user `9207d84de933486d97678ed623491335`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:23.988381 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-50540c1b-36b3-4197-86de-6ad54687e245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:24.055647 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1427/2857] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:24.066596 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ab83f-36bf-4306-ba67-c0dc672f11e9 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:24.068407 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-b17ab83f-36bf-4306-ba67-c0dc672f11e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:24.125446 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ab83f-36bf-4306-ba67-c0dc672f11e9 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:24.129045 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982d76c-5f0b-46cc-bf75-18269497805b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:24.129648 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d76c-5f0b-46cc-bf75-18269497805b service cinder] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:24.129928 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d76c-5f0b-46cc-bf75-18269497805b service cinder] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:24.130201 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d76c-5f0b-46cc-bf75-18269497805b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:24.139621 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982d76c-5f0b-46cc-bf75-18269497805b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:24.141029 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982d76c-5f0b-46cc-bf75-18269497805b service cinder] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:24.151073 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1431/2858] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:24.538607 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50540c1b-36b3-4197-86de-6ad54687e245 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:24.601707 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50540c1b-36b3-4197-86de-6ad54687e245 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:24.606173 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:24.606803 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:24.607113 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:24.607389 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] PATH_INFO: `/v3/users/f67600594f334fb79b58fc0de897ccc6` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:24.608541 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67600594f334fb79b58fc0de897ccc6)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:24.610453 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:24.647975 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:24.657463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67600594f334fb79b58fc0de897ccc6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:24.658109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67600594f334fb79b58fc0de897ccc6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:24.670372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67600594f334fb79b58fc0de897ccc6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:24.682182 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67600594f334fb79b58fc0de897ccc6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:24.682800 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67600594f334fb79b58fc0de897ccc6'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:24.701322 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1428/2859] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:50:24 2022] DELETE /identity/v3/users/f67600594f334fb79b58fc0de897ccc6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:24.705783 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6a84-2760-45a7-9112-3212d2db2584 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:24.706066 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6a84-2760-45a7-9112-3212d2db2584 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:24.706336 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6a84-2760-45a7-9112-3212d2db2584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:24.724311 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-343a6a84-2760-45a7-9112-3212d2db2584 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:24.725486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-343a6a84-2760-45a7-9112-3212d2db2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:24.784673 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1432/2860] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:24.795438 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:24.796836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:24.853728 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdaccc-e16d-4ac8-8d7f-e99bd3005844 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:24.857478 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cee0b9-3b9b-4c7c-8945-f23d7e7dff92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:24.858085 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cee0b9-3b9b-4c7c-8945-f23d7e7dff92 service neutron] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:24.858366 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cee0b9-3b9b-4c7c-8945-f23d7e7dff92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:24.858639 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cee0b9-3b9b-4c7c-8945-f23d7e7dff92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:24.868374 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cee0b9-3b9b-4c7c-8945-f23d7e7dff92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:24.869791 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cee0b9-3b9b-4c7c-8945-f23d7e7dff92 service neutron] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:24.879143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1429/2861] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:25.154519 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a6a84-2760-45a7-9112-3212d2db2584 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:25.156216 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-343a6a84-2760-45a7-9112-3212d2db2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:25.169425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a6a84-2760-45a7-9112-3212d2db2584 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:25.173975 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:25.174611 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:25.174885 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:25.175250 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] PATH_INFO: `/v3/projects/67823bd0fb0e4e8f86048dfc9cc591fd` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:25.176507 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67823bd0fb0e4e8f86048dfc9cc591fd)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:25.178339 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:25.201793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:25.225732 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67823bd0fb0e4e8f86048dfc9cc591fd', 'request_id': 'req-056fec00-2ff9-4e0b-8dad-ba1975480713'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.231877 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67823bd0fb0e4e8f86048dfc9cc591fd', 'request_id': 'req-056fec00-2ff9-4e0b-8dad-ba1975480713'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.239170 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67823bd0fb0e4e8f86048dfc9cc591fd', 'request_id': 'req-056fec00-2ff9-4e0b-8dad-ba1975480713'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.250064 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] The token cache is being invalidate because project 67823bd0fb0e4e8f86048dfc9cc591fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:50:25.250356 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.250970 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.252494 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1433/2862] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:50:25 2022] DELETE /identity/v3/projects/67823bd0fb0e4e8f86048dfc9cc591fd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:25.256477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cee0b9-3b9b-4c7c-8945-f23d7e7dff92 service neutron] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:25.266505 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cee0b9-3b9b-4c7c-8945-f23d7e7dff92 service neutron] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:25.322463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:25.323133 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:25.323415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:25.323687 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] PATH_INFO: `/v3/users/9207d84de933486d97678ed623491335` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:25.324835 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9207d84de933486d97678ed623491335)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:25.326741 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:25.373039 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9207d84de933486d97678ed623491335'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.373694 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9207d84de933486d97678ed623491335'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.381604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:25.387288 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9207d84de933486d97678ed623491335'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.396568 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9207d84de933486d97678ed623491335'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.397161 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-4f03add0-6a3c-4bce-8e14-e5644589deb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9207d84de933486d97678ed623491335'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.412685 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1430/2863] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:50:25 2022] DELETE /identity/v3/users/9207d84de933486d97678ed623491335 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:25.687699 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:25.689143 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:25.702461 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fec00-2ff9-4e0b-8dad-ba1975480713 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:25.767715 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:25.768439 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:25.768740 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:25.769015 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] PATH_INFO: `/v3/projects/f0e3317a34e542a9a829f2f17b7563eb` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:25.770219 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e3317a34e542a9a829f2f17b7563eb)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:25.772189 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:25.818078 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e3317a34e542a9a829f2f17b7563eb', 'request_id': 'req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.824184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e3317a34e542a9a829f2f17b7563eb', 'request_id': 'req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.831465 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e3317a34e542a9a829f2f17b7563eb', 'request_id': 'req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.842838 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] The token cache is being invalidate because project f0e3317a34e542a9a829f2f17b7563eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:50:25.843158 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.843769 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-ae83ce73-9da0-4d2c-b8b3-d95f302636ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:25.845249 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1434/2864] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:50:25 2022] DELETE /identity/v3/projects/f0e3317a34e542a9a829f2f17b7563eb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:25.850217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151cacd-cea0-4d4c-a9cb-b69c1e0d76ac None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:25.850503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151cacd-cea0-4d4c-a9cb-b69c1e0d76ac None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:25.850786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151cacd-cea0-4d4c-a9cb-b69c1e0d76ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:25.870675 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-a151cacd-cea0-4d4c-a9cb-b69c1e0d76ac None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:25.871889 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-a151cacd-cea0-4d4c-a9cb-b69c1e0d76ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:25.929836 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1431/2865] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:25.990936 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94a2c-a37c-4f45-9cb6-039fbc18e2fa None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:25.991272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94a2c-a37c-4f45-9cb6-039fbc18e2fa None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:25.991583 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94a2c-a37c-4f45-9cb6-039fbc18e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.012756 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-2ae94a2c-a37c-4f45-9cb6-039fbc18e2fa None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:26.013960 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-2ae94a2c-a37c-4f45-9cb6-039fbc18e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:26.021862 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1435/2866] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:26.026071 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151cacd-cea0-4d4c-a9cb-b69c1e0d76ac None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.036106 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151cacd-cea0-4d4c-a9cb-b69c1e0d76ac None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.040682 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8f699-9dff-4e16-95ff-c677c60921e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.041283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8f699-9dff-4e16-95ff-c677c60921e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.041563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8f699-9dff-4e16-95ff-c677c60921e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.041834 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8f699-9dff-4e16-95ff-c677c60921e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.042522 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8f699-9dff-4e16-95ff-c677c60921e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80399) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:50:26.042823 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8f699-9dff-4e16-95ff-c677c60921e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.044447 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8f699-9dff-4e16-95ff-c677c60921e1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.056236 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1432/2867] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:50:26.060362 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94a2c-a37c-4f45-9cb6-039fbc18e2fa None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.069456 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94a2c-a37c-4f45-9cb6-039fbc18e2fa None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.074711 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787f1f2-e15a-4b23-a0a0-f2e0170f5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.075349 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787f1f2-e15a-4b23-a0a0-f2e0170f5d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.075628 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787f1f2-e15a-4b23-a0a0-f2e0170f5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.075899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787f1f2-e15a-4b23-a0a0-f2e0170f5d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.076546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787f1f2-e15a-4b23-a0a0-f2e0170f5d6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.078425 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787f1f2-e15a-4b23-a0a0-f2e0170f5d6e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.105010 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1436/2868] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:50:26 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:50:26.109073 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8f699-9dff-4e16-95ff-c677c60921e1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.119845 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8f699-9dff-4e16-95ff-c677c60921e1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.174611 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd934e7-c572-4c49-b039-34b9ca9f8a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.175250 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd934e7-c572-4c49-b039-34b9ca9f8a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.175531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd934e7-c572-4c49-b039-34b9ca9f8a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.175828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd934e7-c572-4c49-b039-34b9ca9f8a35 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.176617 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd934e7-c572-4c49-b039-34b9ca9f8a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.178521 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd934e7-c572-4c49-b039-34b9ca9f8a35 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.202861 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1433/2869] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:50:26 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 04:50:26.205122 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787f1f2-e15a-4b23-a0a0-f2e0170f5d6e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.215398 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787f1f2-e15a-4b23-a0a0-f2e0170f5d6e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.220000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a76c6d-ff41-4a64-8509-a796cf83bfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.220603 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76c6d-ff41-4a64-8509-a796cf83bfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.220901 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76c6d-ff41-4a64-8509-a796cf83bfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.221181 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76c6d-ff41-4a64-8509-a796cf83bfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.221866 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a76c6d-ff41-4a64-8509-a796cf83bfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.223546 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a76c6d-ff41-4a64-8509-a796cf83bfe5 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.228663 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:26.234543 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1437/2870] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:26.238135 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd934e7-c572-4c49-b039-34b9ca9f8a35 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.248551 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd934e7-c572-4c49-b039-34b9ca9f8a35 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.253118 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede9941-6cb3-4a7c-9647-3182f9d61ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.253714 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9941-6cb3-4a7c-9647-3182f9d61ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.253995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9941-6cb3-4a7c-9647-3182f9d61ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.254269 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9941-6cb3-4a7c-9647-3182f9d61ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.254954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede9941-6cb3-4a7c-9647-3182f9d61ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.256563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede9941-6cb3-4a7c-9647-3182f9d61ec3 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.269294 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1434/2871] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:26.272384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a76c6d-ff41-4a64-8509-a796cf83bfe5 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.282793 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a76c6d-ff41-4a64-8509-a796cf83bfe5 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.287452 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfe5fc-ecde-4cfd-a7a1-8f059cd17af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.288169 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfe5fc-ecde-4cfd-a7a1-8f059cd17af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.288486 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfe5fc-ecde-4cfd-a7a1-8f059cd17af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.289329 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfe5fc-ecde-4cfd-a7a1-8f059cd17af1 admin admin] PATH_INFO: `/v3/projects/6b52fef0034c410a8a8e5d05926507d9/users/89c96d4951bf4b009a6181e047c9e809/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.304267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfe5fc-ecde-4cfd-a7a1-8f059cd17af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b52fef0034c410a8a8e5d05926507d9, user_id=89c96d4951bf4b009a6181e047c9e809, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.307533 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfe5fc-ecde-4cfd-a7a1-8f059cd17af1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.320369 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1438/2872] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:50:26 2022] PUT /identity/v3/projects/6b52fef0034c410a8a8e5d05926507d9/users/89c96d4951bf4b009a6181e047c9e809/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:26.330285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005008-0c1e-45ce-91de-ac9df61ac496 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.330578 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005008-0c1e-45ce-91de-ac9df61ac496 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.330855 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005008-0c1e-45ce-91de-ac9df61ac496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.360037 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-52005008-0c1e-45ce-91de-ac9df61ac496 None None] MFA Rules not processed for user `89c96d4951bf4b009a6181e047c9e809`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:26.361232 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-52005008-0c1e-45ce-91de-ac9df61ac496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:26.390480 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:26.425799 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1435/2873] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:26.430846 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfe5fc-ecde-4cfd-a7a1-8f059cd17af1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.490488 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfe5fc-ecde-4cfd-a7a1-8f059cd17af1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.495528 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610fd0-65b0-49d9-8df0-6ca32e39d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.496125 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610fd0-65b0-49d9-8df0-6ca32e39d6ff admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.496399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610fd0-65b0-49d9-8df0-6ca32e39d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.496664 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610fd0-65b0-49d9-8df0-6ca32e39d6ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.497297 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60610fd0-65b0-49d9-8df0-6ca32e39d6ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.499184 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60610fd0-65b0-49d9-8df0-6ca32e39d6ff admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.525091 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1439/2874] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:50:26 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:50:26.529474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52005008-0c1e-45ce-91de-ac9df61ac496 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.540531 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52005008-0c1e-45ce-91de-ac9df61ac496 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.597546 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d1d69-3145-4ea5-9fd6-adae0c867c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.598162 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1d69-3145-4ea5-9fd6-adae0c867c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.598440 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1d69-3145-4ea5-9fd6-adae0c867c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.598712 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1d69-3145-4ea5-9fd6-adae0c867c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.599415 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d1d69-3145-4ea5-9fd6-adae0c867c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.601813 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d1d69-3145-4ea5-9fd6-adae0c867c12 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.622559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1436/2875] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:50:26 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:50:26.626661 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610fd0-65b0-49d9-8df0-6ca32e39d6ff admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.636781 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610fd0-65b0-49d9-8df0-6ca32e39d6ff admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.641300 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d441-b00a-4429-87d6-8259480250d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.641899 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d441-b00a-4429-87d6-8259480250d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.642178 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d441-b00a-4429-87d6-8259480250d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.642448 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d441-b00a-4429-87d6-8259480250d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.643174 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d441-b00a-4429-87d6-8259480250d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.644755 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d441-b00a-4429-87d6-8259480250d1 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.655920 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1440/2876] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:26.659776 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d1d69-3145-4ea5-9fd6-adae0c867c12 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.670262 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d1d69-3145-4ea5-9fd6-adae0c867c12 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.674798 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e011cb-a764-4887-bfc1-f2899476f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.675559 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e011cb-a764-4887-bfc1-f2899476f1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.675839 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e011cb-a764-4887-bfc1-f2899476f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.676109 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e011cb-a764-4887-bfc1-f2899476f1ef admin admin] PATH_INFO: `/v3/projects/e07f70fcbcef4a94839baeed7cac6b69/users/3fc6894e74f14621a59761d594e95063/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.690429 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e011cb-a764-4887-bfc1-f2899476f1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07f70fcbcef4a94839baeed7cac6b69, user_id=3fc6894e74f14621a59761d594e95063, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.693563 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e011cb-a764-4887-bfc1-f2899476f1ef admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.706143 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1437/2877] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:50:26 2022] PUT /identity/v3/projects/e07f70fcbcef4a94839baeed7cac6b69/users/3fc6894e74f14621a59761d594e95063/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 04:50:26.709990 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d441-b00a-4429-87d6-8259480250d1 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.720704 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d441-b00a-4429-87d6-8259480250d1 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.779426 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f95cc-9b1b-474a-9609-d6cae3370d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.780037 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f95cc-9b1b-474a-9609-d6cae3370d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.780316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f95cc-9b1b-474a-9609-d6cae3370d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.780588 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f95cc-9b1b-474a-9609-d6cae3370d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.781275 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f95cc-9b1b-474a-9609-d6cae3370d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.782843 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f95cc-9b1b-474a-9609-d6cae3370d90 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.794137 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1441/2878] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:26.798378 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e011cb-a764-4887-bfc1-f2899476f1ef admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.809233 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e011cb-a764-4887-bfc1-f2899476f1ef admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:26.813814 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb376f-d4a3-47db-80ac-0eecccc97ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:26.814469 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb376f-d4a3-47db-80ac-0eecccc97ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.814748 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb376f-d4a3-47db-80ac-0eecccc97ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.815049 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb376f-d4a3-47db-80ac-0eecccc97ca9 admin admin] PATH_INFO: `/v3/projects/e07f70fcbcef4a94839baeed7cac6b69/users/3fc6894e74f14621a59761d594e95063/roles/c1429555635349208e8b2bd908436746` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.816995 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb376f-d4a3-47db-80ac-0eecccc97ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07f70fcbcef4a94839baeed7cac6b69, user_id=3fc6894e74f14621a59761d594e95063, role_id=c1429555635349208e8b2bd908436746)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:26.819657 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb376f-d4a3-47db-80ac-0eecccc97ca9 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:26.829865 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1438/2879] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:50:26 2022] PUT /identity/v3/projects/e07f70fcbcef4a94839baeed7cac6b69/users/3fc6894e74f14621a59761d594e95063/roles/c1429555635349208e8b2bd908436746 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:26.840424 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61ee68-da4f-4957-a8c5-f5d709a35664 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:26.840718 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61ee68-da4f-4957-a8c5-f5d709a35664 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:26.841006 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61ee68-da4f-4957-a8c5-f5d709a35664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:26.869094 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-ec61ee68-da4f-4957-a8c5-f5d709a35664 None None] MFA Rules not processed for user `3fc6894e74f14621a59761d594e95063`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:26.870303 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-ec61ee68-da4f-4957-a8c5-f5d709a35664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:26.903363 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:26.939316 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1442/2880] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:26.949907 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb376f-d4a3-47db-80ac-0eecccc97ca9 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:26.951627 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-78bb376f-d4a3-47db-80ac-0eecccc97ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:27.008946 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb376f-d4a3-47db-80ac-0eecccc97ca9 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:27.012680 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136ff55-eeb7-452a-a600-696eb5be8004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a7ad7efdc2849ca98386decbfd77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:27.013285 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136ff55-eeb7-452a-a600-696eb5be8004 service cinder] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:27.013562 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136ff55-eeb7-452a-a600-696eb5be8004 service cinder] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:27.013831 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136ff55-eeb7-452a-a600-696eb5be8004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:27.022632 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136ff55-eeb7-452a-a600-696eb5be8004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:27.024670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136ff55-eeb7-452a-a600-696eb5be8004 service cinder] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:27.034116 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1439/2881] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:27.452160 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61ee68-da4f-4957-a8c5-f5d709a35664 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:27.513795 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61ee68-da4f-4957-a8c5-f5d709a35664 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:27.518312 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:27.518994 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:27.519281 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:27.519556 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] PATH_INFO: `/v3/users/89c96d4951bf4b009a6181e047c9e809` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:27.520721 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c96d4951bf4b009a6181e047c9e809)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:27.522620 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:27.569384 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c96d4951bf4b009a6181e047c9e809'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:27.570590 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c96d4951bf4b009a6181e047c9e809'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:27.582185 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c96d4951bf4b009a6181e047c9e809'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:27.589024 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c96d4951bf4b009a6181e047c9e809'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:27.595971 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c96d4951bf4b009a6181e047c9e809'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:27.602243 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1443/2882] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:50:27 2022] DELETE /identity/v3/users/89c96d4951bf4b009a6181e047c9e809 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:27.606734 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6669-ab19-4e6e-96e4-6a246ff545a9 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:27.607259 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6669-ab19-4e6e-96e4-6a246ff545a9 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:27.607370 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6669-ab19-4e6e-96e4-6a246ff545a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:27.626609 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-bbed6669-ab19-4e6e-96e4-6a246ff545a9 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:27.628134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bbed6669-ab19-4e6e-96e4-6a246ff545a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:27.649497 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:27.692283 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1440/2883] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:27.702706 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:27.704127 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:27.762380 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc8224-ad8c-4328-a7f4-b4aa43c21a11 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:27.765997 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b1dd5-c302-44d5-97b4-4747c53cacdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:27.766610 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b1dd5-c302-44d5-97b4-4747c53cacdd service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:27.766883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b1dd5-c302-44d5-97b4-4747c53cacdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:27.767163 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b1dd5-c302-44d5-97b4-4747c53cacdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:27.773479 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:27.778419 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b1dd5-c302-44d5-97b4-4747c53cacdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:27.780512 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b1dd5-c302-44d5-97b4-4747c53cacdd service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:27.790883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1444/2884] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:28.050621 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6669-ab19-4e6e-96e4-6a246ff545a9 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:28.052172 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-bbed6669-ab19-4e6e-96e4-6a246ff545a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:28.064473 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6669-ab19-4e6e-96e4-6a246ff545a9 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:28.069035 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:28.069670 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:28.069951 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:28.070218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] PATH_INFO: `/v3/projects/6b52fef0034c410a8a8e5d05926507d9` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:28.071477 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b52fef0034c410a8a8e5d05926507d9)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:28.073409 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:28.121849 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b52fef0034c410a8a8e5d05926507d9', 'request_id': 'req-5ae5438c-8a32-4b47-89d1-a7133ca2330b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.127257 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b52fef0034c410a8a8e5d05926507d9', 'request_id': 'req-5ae5438c-8a32-4b47-89d1-a7133ca2330b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.134309 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b52fef0034c410a8a8e5d05926507d9', 'request_id': 'req-5ae5438c-8a32-4b47-89d1-a7133ca2330b'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.144980 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] The token cache is being invalidate because project 6b52fef0034c410a8a8e5d05926507d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:50:28.145260 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.145872 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.147386 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1441/2885] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:50:28 2022] DELETE /identity/v3/projects/6b52fef0034c410a8a8e5d05926507d9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:28.151825 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b1dd5-c302-44d5-97b4-4747c53cacdd service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:28.161412 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b1dd5-c302-44d5-97b4-4747c53cacdd service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:28.216474 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:28.217100 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:28.217375 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:28.217645 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] PATH_INFO: `/v3/users/3fc6894e74f14621a59761d594e95063` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:28.218776 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc6894e74f14621a59761d594e95063)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:28.220708 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:28.264581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc6894e74f14621a59761d594e95063'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.265207 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc6894e74f14621a59761d594e95063'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.277203 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc6894e74f14621a59761d594e95063'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.284172 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc6894e74f14621a59761d594e95063'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.292007 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-daaa7895-eae9-486d-8cc4-9211e0905f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc6894e74f14621a59761d594e95063'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.297809 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1445/2886] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:50:28 2022] DELETE /identity/v3/users/3fc6894e74f14621a59761d594e95063 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:28.582437 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:28.583892 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:28.599540 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5438c-8a32-4b47-89d1-a7133ca2330b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:28.658642 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:28.659344 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:28.659566 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:28.659837 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] PATH_INFO: `/v3/projects/e07f70fcbcef4a94839baeed7cac6b69` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:28.660991 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07f70fcbcef4a94839baeed7cac6b69)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:28.662895 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:28.708308 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07f70fcbcef4a94839baeed7cac6b69', 'request_id': 'req-08785d4a-48e0-4b63-9e3f-61c3c4957030'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.710218 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:28.714604 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07f70fcbcef4a94839baeed7cac6b69', 'request_id': 'req-08785d4a-48e0-4b63-9e3f-61c3c4957030'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.722134 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07f70fcbcef4a94839baeed7cac6b69', 'request_id': 'req-08785d4a-48e0-4b63-9e3f-61c3c4957030'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.733463 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] The token cache is being invalidate because project e07f70fcbcef4a94839baeed7cac6b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:50:28.733747 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.734384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-08785d4a-48e0-4b63-9e3f-61c3c4957030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:28.735917 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1442/2887] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:50:28 2022] DELETE /identity/v3/projects/e07f70fcbcef4a94839baeed7cac6b69 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:28.740804 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992586b-54c5-477d-9a9b-b99ee7f00cf1 None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:28.741267 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992586b-54c5-477d-9a9b-b99ee7f00cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:28.741382 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992586b-54c5-477d-9a9b-b99ee7f00cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:28.761408 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-c992586b-54c5-477d-9a9b-b99ee7f00cf1 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:28.762598 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-c992586b-54c5-477d-9a9b-b99ee7f00cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:28.823003 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1446/2888] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:28.831027 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d28c-fe3a-4df6-8607-51fe37ca3924 None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:28.831317 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d28c-fe3a-4df6-8607-51fe37ca3924 None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:28.831590 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d28c-fe3a-4df6-8607-51fe37ca3924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:28.850904 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-b530d28c-fe3a-4df6-8607-51fe37ca3924 None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:28.852775 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-b530d28c-fe3a-4df6-8607-51fe37ca3924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:28.860623 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1443/2889] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:28.864812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992586b-54c5-477d-9a9b-b99ee7f00cf1 None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:28.875911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992586b-54c5-477d-9a9b-b99ee7f00cf1 None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:28.880455 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07165-76db-42a8-ab58-fcac6e46fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:28.881058 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07165-76db-42a8-ab58-fcac6e46fa63 admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:28.881335 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07165-76db-42a8-ab58-fcac6e46fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:28.881602 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07165-76db-42a8-ab58-fcac6e46fa63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:28.882285 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad07165-76db-42a8-ab58-fcac6e46fa63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 04:50:28.882584 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad07165-76db-42a8-ab58-fcac6e46fa63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:28.884186 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad07165-76db-42a8-ab58-fcac6e46fa63 admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:28.894617 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:28.901522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1447/2890] 10.222.0.57 () {58 vars in 1153 bytes} [Thu Aug 4 04:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 04:50:28.906215 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d28c-fe3a-4df6-8607-51fe37ca3924 None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:28.916945 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d28c-fe3a-4df6-8607-51fe37ca3924 None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:28.921589 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a70c1-3921-4858-91c0-3dc7419b718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:28.922207 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a70c1-3921-4858-91c0-3dc7419b718b admin admin] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:28.922494 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a70c1-3921-4858-91c0-3dc7419b718b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:28.922769 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a70c1-3921-4858-91c0-3dc7419b718b admin admin] PATH_INFO: `/v3/projects` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:28.923592 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a70c1-3921-4858-91c0-3dc7419b718b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:28.925503 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a70c1-3921-4858-91c0-3dc7419b718b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:28.953311 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1444/2891] 10.222.0.57 () {60 vars in 1153 bytes} [Thu Aug 4 04:50:28 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:50:28.957522 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07165-76db-42a8-ab58-fcac6e46fa63 admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:28.967883 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07165-76db-42a8-ab58-fcac6e46fa63 admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:29.023831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a15d4-914e-4442-b5a5-9a29b833297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:29.024437 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a15d4-914e-4442-b5a5-9a29b833297d admin admin] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:29.024719 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a15d4-914e-4442-b5a5-9a29b833297d admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:29.024991 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a15d4-914e-4442-b5a5-9a29b833297d admin admin] PATH_INFO: `/v3/users` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:29.025644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a15d4-914e-4442-b5a5-9a29b833297d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:29.027581 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a15d4-914e-4442-b5a5-9a29b833297d admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:29.049354 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1448/2892] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Aug 4 04:50:28 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 04:50:29.053475 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a70c1-3921-4858-91c0-3dc7419b718b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:29.063633 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a70c1-3921-4858-91c0-3dc7419b718b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:29.068208 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4b96b-ec7e-4247-b421-e08021a8b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:29.068818 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4b96b-ec7e-4247-b421-e08021a8b7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:29.069097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4b96b-ec7e-4247-b421-e08021a8b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:29.069372 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4b96b-ec7e-4247-b421-e08021a8b7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:29.070088 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4b96b-ec7e-4247-b421-e08021a8b7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:29.071706 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4b96b-ec7e-4247-b421-e08021a8b7b1 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:29.081569 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1445/2893] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:29.085911 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a15d4-914e-4442-b5a5-9a29b833297d admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:29.095788 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a15d4-914e-4442-b5a5-9a29b833297d admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:29.100633 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6975de-72f4-4b0c-8d50-10bce1194feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:29.101812 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6975de-72f4-4b0c-8d50-10bce1194feb admin admin] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:29.102091 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6975de-72f4-4b0c-8d50-10bce1194feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:29.102358 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6975de-72f4-4b0c-8d50-10bce1194feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:29.103106 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6975de-72f4-4b0c-8d50-10bce1194feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:29.104712 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6975de-72f4-4b0c-8d50-10bce1194feb admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:29.115241 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1449/2894] 10.222.0.57 () {58 vars in 1122 bytes} [Thu Aug 4 04:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 04:50:29.119226 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4b96b-ec7e-4247-b421-e08021a8b7b1 admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:29.129054 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4b96b-ec7e-4247-b421-e08021a8b7b1 admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:29.133631 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b76b14-995e-4af0-a1c1-47b2ce939e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:29.134275 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76b14-995e-4af0-a1c1-47b2ce939e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:29.134555 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76b14-995e-4af0-a1c1-47b2ce939e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:29.134828 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76b14-995e-4af0-a1c1-47b2ce939e7b admin admin] PATH_INFO: `/v3/projects/6ef5a0cece9e44e6a34d644603e7d323/users/ca92e3f64f70436cbe516d45e2aa48f3/roles/a8a24aac5beb466aa9599c299ab9ec1a` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:29.149625 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76b14-995e-4af0-a1c1-47b2ce939e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef5a0cece9e44e6a34d644603e7d323, user_id=ca92e3f64f70436cbe516d45e2aa48f3, role_id=a8a24aac5beb466aa9599c299ab9ec1a)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:29.152384 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76b14-995e-4af0-a1c1-47b2ce939e7b admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:29.165954 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1446/2895] 10.222.0.57 () {60 vars in 1483 bytes} [Thu Aug 4 04:50:29 2022] PUT /identity/v3/projects/6ef5a0cece9e44e6a34d644603e7d323/users/ca92e3f64f70436cbe516d45e2aa48f3/roles/a8a24aac5beb466aa9599c299ab9ec1a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:29.176190 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103244d8-ae1d-4cb5-8fc2-fd5b7f316c4b None None] REQUEST_METHOD: `POST` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:29.176421 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103244d8-ae1d-4cb5-8fc2-fd5b7f316c4b None None] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:29.176694 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103244d8-ae1d-4cb5-8fc2-fd5b7f316c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:29.203644 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.auth.core [None req-103244d8-ae1d-4cb5-8fc2-fd5b7f316c4b None None] MFA Rules not processed for user `ca92e3f64f70436cbe516d45e2aa48f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:29.204831 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-103244d8-ae1d-4cb5-8fc2-fd5b7f316c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:29.267399 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1450/2896] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:29.279280 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b76b14-995e-4af0-a1c1-47b2ce939e7b admin admin] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:29.281062 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-d4b76b14-995e-4af0-a1c1-47b2ce939e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:29.336764 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b76b14-995e-4af0-a1c1-47b2ce939e7b admin admin] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:29.340398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bf36c-99b4-4ec6-9bb4-0daf3547197f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955c6cb8893c473fadd028b12bbea69d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:29.341007 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bf36c-99b4-4ec6-9bb4-0daf3547197f service glance] REQUEST_METHOD: `GET` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:29.341291 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bf36c-99b4-4ec6-9bb4-0daf3547197f service glance] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:29.341565 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bf36c-99b4-4ec6-9bb4-0daf3547197f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:29.350065 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bf36c-99b4-4ec6-9bb4-0daf3547197f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:29.351525 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826bf36c-99b4-4ec6-9bb4-0daf3547197f service glance] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:29.360443 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1447/2897] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:39.264475 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:39.356398 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:44.844000 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103244d8-ae1d-4cb5-8fc2-fd5b7f316c4b None None] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:44.906152 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103244d8-ae1d-4cb5-8fc2-fd5b7f316c4b None None] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:44.910651 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:44.911314 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:44.911597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:44.911872 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] PATH_INFO: `/v3/users/ca92e3f64f70436cbe516d45e2aa48f3` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:44.913032 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca92e3f64f70436cbe516d45e2aa48f3)` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:44.914952 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:44.959802 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca92e3f64f70436cbe516d45e2aa48f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:44.961016 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca92e3f64f70436cbe516d45e2aa48f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:44.973306 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca92e3f64f70436cbe516d45e2aa48f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:44.980377 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca92e3f64f70436cbe516d45e2aa48f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:44.987771 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.notifications [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca92e3f64f70436cbe516d45e2aa48f3'} {{(pid=80398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:44.994238 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1451/2898] 10.222.0.57 () {58 vars in 1224 bytes} [Thu Aug 4 04:50:44 2022] DELETE /identity/v3/users/ca92e3f64f70436cbe516d45e2aa48f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:44.998673 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1dfbe-200e-46f4-92d8-63bbbb26e8ca None None] REQUEST_METHOD: `POST` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:44.999220 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1dfbe-200e-46f4-92d8-63bbbb26e8ca None None] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:44.999331 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1dfbe-200e-46f4-92d8-63bbbb26e8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:45.018319 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.auth.core [None req-cfe1dfbe-200e-46f4-92d8-63bbbb26e8ca None None] MFA Rules not processed for user `bf61353eb0614c70aa286ba9e0760696`. Rule list: `[]` (Enabled: `True`). {{(pid=80399) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 04:50:45.019474 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cfe1dfbe-200e-46f4-92d8-63bbbb26e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:45.077217 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1448/2899] 10.222.0.57 () {58 vars in 958 bytes} [Thu Aug 4 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 04:50:45.087072 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:45.088464 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:45.144530 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9737c-1f33-42c3-a59a-f6059143823e admin admin] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:45.148180 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95b670-f162-417a-bbb2-d8b955d5ed5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c426cc367a1843d38978d3b8e636276e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:45.148790 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95b670-f162-417a-bbb2-d8b955d5ed5a service neutron] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:45.149071 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95b670-f162-417a-bbb2-d8b955d5ed5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:45.149348 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95b670-f162-417a-bbb2-d8b955d5ed5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:45.158445 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95b670-f162-417a-bbb2-d8b955d5ed5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:45.159913 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95b670-f162-417a-bbb2-d8b955d5ed5a service neutron] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:45.169091 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1452/2900] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:50:45.435749 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1dfbe-200e-46f4-92d8-63bbbb26e8ca None None] Authenticating user token {{(pid=80399) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:50:45.437237 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.fernet_utils [None req-cfe1dfbe-200e-46f4-92d8-63bbbb26e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80399) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:50:45.450077 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1dfbe-200e-46f4-92d8-63bbbb26e8ca None None] Validating token access rules against request {{(pid=80399) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:50:45.454771 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf61353eb0614c70aa286ba9e0760696', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '998b35aeaf484d148461559c217775c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80399) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:50:45.456076 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:50:45.456558 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:50:45.456844 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] PATH_INFO: `/v3/projects/6ef5a0cece9e44e6a34d644603e7d323` {{(pid=80399) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:50:45.458023 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef5a0cece9e44e6a34d644603e7d323)` {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:50:45.459972 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] RBAC: Authorization granted {{(pid=80399) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:50:45.506786 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef5a0cece9e44e6a34d644603e7d323', 'request_id': 'req-bf632f85-a115-4819-bd22-411d3b658ea5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:45.512663 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef5a0cece9e44e6a34d644603e7d323', 'request_id': 'req-bf632f85-a115-4819-bd22-411d3b658ea5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:45.519683 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef5a0cece9e44e6a34d644603e7d323', 'request_id': 'req-bf632f85-a115-4819-bd22-411d3b658ea5'} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:45.531170 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] The token cache is being invalidate because project 6ef5a0cece9e44e6a34d644603e7d323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80399) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 04:50:45.531461 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:45.532097 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG keystone.notifications [None req-bf632f85-a115-4819-bd22-411d3b658ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80399) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 04:50:45.533583 dv-cinder-851279-5-smb devstack@keystone.service[80399]: [pid: 80399|app: 0|req: 1449/2901] 10.222.0.57 () {58 vars in 1233 bytes} [Thu Aug 4 04:50:45 2022] DELETE /identity/v3/projects/6ef5a0cece9e44e6a34d644603e7d323 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 04:50:55.165054 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:50:55.527891 dv-cinder-851279-5-smb devstack@keystone.service[80399]: DEBUG dbcounter [-] [80399] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 04:53:42.764668 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95b670-f162-417a-bbb2-d8b955d5ed5a service neutron] Authenticating user token {{(pid=80398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 04:53:42.766396 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-3c95b670-f162-417a-bbb2-d8b955d5ed5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:53:42.836597 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95b670-f162-417a-bbb2-d8b955d5ed5a service neutron] Validating token access rules against request {{(pid=80398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 04:53:42.895331 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846068fb-8d25-4cbe-af9d-78aa388510ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5c20a5a655b43d1899bf2319647a894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '642faef2d1654874bd7205420512998a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 04:53:42.895943 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846068fb-8d25-4cbe-af9d-78aa388510ee service placement] REQUEST_METHOD: `GET` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 04:53:42.896224 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846068fb-8d25-4cbe-af9d-78aa388510ee service placement] SCRIPT_NAME: `/identity` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 04:53:42.896502 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846068fb-8d25-4cbe-af9d-78aa388510ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 04:53:42.898272 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.fernet_utils [None req-846068fb-8d25-4cbe-af9d-78aa388510ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 04:53:42.909632 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846068fb-8d25-4cbe-af9d-78aa388510ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 04:53:42.911223 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846068fb-8d25-4cbe-af9d-78aa388510ee service placement] RBAC: Authorization granted {{(pid=80398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 04:53:42.920987 dv-cinder-851279-5-smb devstack@keystone.service[80398]: [pid: 80398|app: 0|req: 1453/2902] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Aug 4 04:53:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 04:53:52.916724 dv-cinder-851279-5-smb devstack@keystone.service[80398]: DEBUG dbcounter [-] [80398] Writing DB stats keystone:SELECT=58 {{(pid=80398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}